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Other network 
attached storage 
includes something 
ours doesn’t 








Namely, a big fdt Clldfg6 for software. 

Here are your choices. The other guys’ NAS that includes a big fat charge for their proprietary software. 
Or our high performance, high density VA Linux 9450 NAS. It comes with, for no charge whatsoever, 
our comprehensive Open Source NetAttach software, which includes a Logical Volume Manager, 
snapshot capability,’*' journalled file system, remote web-based management and more. The 9450 offers 
three PCI buses. Multiple RAID controllers. Integrated 10/100 or Gigabit Ethernet. And it scales from 
180GB to 6.6TB in a 26U rack.’*^’*^ So your best NAS choice? Wave goodbye to the other guys. 
Call 1-877-VA-LINUX, or visit www.valinux.com. And get more NAS for less. 
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S T E M S 


The World’s Linux Leader. 


a tnuleimirk ofVA Linux SyUems. Inc. Linux is a regtsieral Inideimirk of Linus Tomilds. All oilier inideuuirks or tradenames mentioned herein are the pro]ret1y of their rc>specHve holders. ''^Snapshot available in NetAttach i;.L i. 

mentioned are native sptem capacities. ©2001 VA Linux Sptems, Inc. All rights resened. 













My data center stays up all night. 
I don't have to. 

Linuxcare and Turbolinux have joined forces to deliver the most complete 
high-availability solutions for your data center. 


©2001 Turbolinux, Inc. All rights reserved. Turbolinux is a registered 


Now one company offers the most powerful clustering 
and supercomputing software—backed by the best 
services in the industry. Turbocharge your server farm 
or data center with scalable, reliable, open-source- 
powered solutions that perform no matter which Linux 
distribution you prefer. Find out more at 
www.turbolinux.com today. 
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How Unux Works With Microsoft Networking Protocois 


By Christopher R. Hertel 

Microsoft networking protocols such as SMB, NetBIOS, and CIFS are used 
everywhere. Open source developers need to understand how they work 
in order for Linux to become a mainstream operating system. 



Sun Microsystems is learning to live with 
Open Source Whether They like it or Not 


By Robert McMillan 

Sun Microsystems cannot ignore the open source community, and the 
open source community cannot ignore Sun. While Sun’s history with 
open source is slightly checkered, the times do seem to be a changin’. 




Bvsb is Ini « 

Red Hat’s Matthew Szuiik is invenUng the linux Business Modei 

By Robert McMillan 

Red Hat Software is a true trailblazer in the open source community. 

We spoke with Red Hat CEO Matt Szuiik about the challenges and 
opportunities facing his company, both commercial and philosophical. 




Shutding Packets Areund the internet 
With RiP and RiPv2 

By Craig Hunt 

Routing Information Protocol (RIP) and its 
successor RIPv2 are the glue that 
makes the Internet work. Here’s how. 
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Services, Baby, Services 


S ervices. In the past few years, as 
Linux has developed into a more 
mainstream operating system, a 
new axiom has emerged — you 
can’t make much money selling 
the OS itself, but many companies can 
make money by selling their services 
around the OS. 

About a year ago, Tim O’Reilly wrote 
what I believe to be an incredibly in¬ 
sightful piece on this subject (found 
online at http://www.oreillynet.com/ 
pub/a/rinux/2000/05/09/lessons. 
html). I think that it is now worthwhile 
to re-visit this issue and take a close 
look at how some of the more promis¬ 
ing open source business models have 
been evolving. 

The first example that leaps to mind 
is Red Hat. While Red Hat has derived 
a great deal of their revenue to date 
from traditional “service and support” 
contracts with large corporate custom¬ 
ers, it’s clear that they are continuing 
to look for new models that will sup¬ 
port their business. The most interest¬ 
ing of these new models is the Red Hat 
Network (RHN). 

The RHN is based on a subscription 
model, where users of Red Hat Linux 
register themselves with RHN. The Red 
Hat Network will then provide users 
with constantly updated packages and 
bug fixes for all of the software that is 
installed on their systems. 

Basic service is free for all users of 
Red Hat 6.2 or greater. However, many 
useful premium services are only avail¬ 
able for a fee — on a subscription ba¬ 
sis. So basically. Red Hat is helping 
their customers by managing their soft¬ 
ware for them over the Internet. If 
users find this to be a valuable service 
(and I certainly believe they will). Red 
Hat will derive a large revenue stream 
from it. 

Hmmm...The two key words here 
seem to be “managing” and “service.” 
This leads me to the next business 
model that I have seen emerging over 
the last year or so; there are now a slew 


of companies that have sprung up to 
offer managed hosting services to cor¬ 
porate America. 

From traditional hardware manu¬ 
facturers such as Dell (DellHost), Mi¬ 
cron (HostPro), and IBM to new up¬ 
start “pure play” service providers such 
as Backspace and Verio, an enormous 
number of service providers are offer¬ 
ing corporate IT departments the op¬ 
tion of outsourcing their entire infra¬ 
structure. 

All of these providers offer their cus¬ 
tomers the opportunity to save time and 
money by having someone else deal 
with the headaches of managing their 
systems. Many of these providers do, 
in fact, use Linux as the foundation of 
their service offerings. 

So, is it possible for you to make 
money utilizing the traditional “cus¬ 
tomer service and support” model and 
Linux? Absolutely. IBM Global Servi¬ 
ces, for example, is quite likely to make 
a mint. Many distributions and tradi¬ 
tional support companies stand a ra¬ 
ther good chance of capturing some of 
that business as well — not to men¬ 
tion the army of VARs that I believe 
will want to begin selling Linux to their 
clients. 

The point I’m trying to make is that 
(as Tim O’Reilly also noted) opportu¬ 
nities here are much greater than what 
exists in the traditional model alone. 
Linux and the Internet together are 
causing dislocation in the world of in¬ 
formation technology. Those compa¬ 
nies that can identify these dislocations 
and use them to provide customers 
with better, cheaper, and more efficient 
ways of running their businesses will 
be the ones that are likely to benefit 
the most. 

See you next month. 



Adam M. Goodman 
President & Publisher 
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Beware Sofmare Ston^ 
Baring SIfKs 

I just finished reading “Embrace & Ex¬ 
tend” (February 2001) and believe that 
your position regarding Microsoft is a 
bit naive. However well-reasoned Mi¬ 
crosoft’s .NET may be — and 1 agree 
it sounds good — we 
cannot afford the luxu¬ 
ry of ignoring the Mi¬ 
crosoft common de¬ 
nominator; everything 
Microsoft does with re¬ 
gard to the Internet is 
a clandestine attempt to 
gain proprietary control 
of the Internet or an in¬ 
direct attempt to control 
what software people 
use. Evidence to sup¬ 
port this is so overwhelming that only 
Microsoft’s lawyers think there is any 
point in discussing it. 

The bottom line is that we cannot 
afford to use anything from Redmond, 
no matter how appealing and seem¬ 
ingly useful. If just one proprietary 
Microsoft tool becomes an Internet 
standard, we will have made a gift of 
the whole Internet to Uncle Bill. Be 
assured, there will be something at¬ 
tached to the seemingly free gift. 1 
would rather spend the rest of my life 
chopping wood with a stone axe than 
run the risk of buying an electric heater 
from Redmond. The price is too high. 

At the moment, total control of the 
Internet is in the hands of Unix/Linux. 
Gates knows this and wants to change 
it. Not one brick used to construct the 
Internet must ever come from Red¬ 
mond. .NET is a Trojan horse if ever 
there was one. 

David Rachel 
The Mac Workshop 

My SomiMinieiils to iio &mt 

I just got through reading “The Truth 
About Text — Part III” [Newbies, March 


2001). Great article! I learned a lot 
about VL Can I look forward to an ar¬ 
ticle or two on emacs? I’ve always 
been mystified by vi; I know it’s a 
powerful text editor, and your articles 
did much to help me realize why it’s 
on nearly every Unix/Linux system. 1 
know emacs is also quite powerful 
and would like to learn 
how it works and what 
makes it so great. 

I also appreciated “Hey! 
Leggo MySQL” (March 
2001). Hopefully, there 
will be more articles on 
MySQL in the near future. 
Of course. I’d also like to 
find one on PostgreSQL, 
since 1 know that there is 
“competition” between 
these two database apps. 

Thank you for your magazine; it 
keeps me up-to-date and gives good in¬ 
formation in a pleasant, informative 
(and occasionally humorous) way. 

Russell Hires 

Easier than procmail 

You recently responded to a Tech Sup¬ 
port question (March 2001) about ar¬ 
chiving inbound e-mail and suggested 
using procmail A simpler solution that 
works on almost all Unix systems is 
to use the standard .forward file capa¬ 
bility of sendmail and sendmail-com- 
patible transport agents. The .forward 
file looks like: 

\username, /home/username/ 
archive/email 

The backslash in front of the username 
prevents further aliasing or forwarding. 
The second entry is the name of a file 
to which sendmail will write the in¬ 
coming mail. 

While obviously not as flexible as 
the pattern matching capabilities of 
procmail sendmail does the job and is 
much easier for the user to configure 


if procmail is not available on their 
system. 

Dan Trottier 

Check out this month's Guru Guidance 
column for more on this subject. -Ed 

WhidoMfs and Linux eoexisttng 

The Tech Support column in your 
March 2001 issue really caught my eye. 
Unfortunately, it only addressed how 
to mount and access data on the Win¬ 
dows partition. What would be really 
useful is an in-depth article discussing 
how data can be shared between appli¬ 
cations in Windows and Linux. 

For example, is it possible to set up 
Netscape to use the same bookmark 
file in Windows and Linux? How about 
mail files? What are some good prac¬ 
tices for setting up a directory structure 
to support file sharing? 

While 1 find myself using Linux 
more, there are still some applications 
I really want to use that are only avail¬ 
able under Windows — in particular, 
my Palm conduit applications. While 
I’ve set up J-Pilot and can do Hot 
Syncs, there is still an absence of con¬ 
duits and desktop applications that 
utilize data on the Palm. 

Pocket Quicken from Landsware, for 
example, allows you to sync financial 
data on the Palm with the Quicken ap¬ 
plication. GnuCash doesn’t have such 
a conduit yet. It is these types of appli¬ 
cations that will help convince me to 
move to a single boot system. Until 
then, I plan to use both OSes. Any in¬ 
formation on sharing data between 
the two would be a welcomed addi¬ 
tion to your fine magazine. 

Tom Newman 

Clarke County, VA 


Linux Magazine welcomes feedback 
and comments. Letters will be edited 
for clarity and space; please be sure to 
include your name and location. Send 
letters to editors@linux-mag.com. 
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Report from the Front 




Linux is set to realize a 300 to 400 percent growth in the 
retail point-of-sale (POS) market this year, according to 
the IHL Consulting Group. 

In 2000, Linux had but a 2 percent share of 
the POS market, but with large rollouts from 
Home Depot and MusicLand totaling approx- 
imately 25,000 Linux units, 2001 looks to be 
the year that the open source OS makes it big 


According to IHLs study, large retailers and 
specialty retailers with larger IT staffs are 
more likely to embrace Linux as a POS solu¬ 
tion. While Linux may not carry a license fee, smaller re¬ 
tailers might not be able to justify the overhead costs of 
implementing a Linux solution. 

The study was conducted for 4 
the Association of Retail Tech- 
nology Standards (ARTS). http:// J MUSI CLAN D 

www.ihlservice8;eprh 


IBM Adopts UnuM for tfsis Sto^e Standanl 


IBM is developing a new 

tached Storage (NAS). iSCSI "Sr" "liiiiSii 

is based on the SCSI proto- ■■■ *■■■■ 

col but operates over TCP/ wm mm mm mm \ 

The TotalStorage IP 200i 

is a Linux-based NAS solution that implements the 
iSCSI protocol. IBM plans to introduce the IP lOOi later 
this year with prices starting at $20,000. 

The iSCSI protocol is part of a push to deliver an 
open network storage solution. IBM is working with 
Cisco Systems to make it an Internet Engineering Task 
Force (IETF) standard, http://www.ibm.com 


liersssfis? 

The war of words between Microsoft and Free 
Software and Open Source proponents heated up 
in February. Jim Alehin, VP of Microsoft’s Plat¬ 
forms Group, called Open Source an “intellectu¬ 
al property destroyer” in a February interview. 
Alehin’s comments were specifically targeted at 
legislators; He claimed that GPLed or Open Source 
software stifles innovation by companies like Mi¬ 
crosoft. Alehin’s comments came about a month 
after Microsoft’s Steve Ballmer called Linux their 
top threat. 

Microsoft officials later clarified that Alehin’s 
primary concern is the fact that the GNU General 
Public License 
stipulates that 
code licensed 
under the GPL 
must stay un¬ 
der the GPL if modified. Apparently, Microsoft 
feels that BSD-style licenses that do not require 
third parties to give back code are fine, dp: // 
www.microsoft.com 


K/Bcmso/t 


iewieti-Packaril Ends QasiiMaR 

Hewlett-Packard recently announced that the 
upcoming 7.0 release of their Open- 
Mail groupware messaging prod¬ 
uct would in fact be its final 
0 ^ ^ ^ -31 major release. 

Gffp^&iwtSUM OpenMail is the only mes¬ 
saging software currently av¬ 
ailable for Unix and Linux that sup¬ 
ports MicrosofLs MAPI 
^ protocol. This allows com- 

by LINUX panics to take advantage of 
some of Microsoft Outlook’s 
capabilities without being forced to standard¬ 
ize their systems on Microsoft Exchange. 

Bruce Perens, HP’s Senior Strategist for Lin¬ 
ux and Open Source, indicated that there are 
discussions underway within HP that may lead 
to OpenMail being released under an Open 
Source license, but no firm decision has yet 
been reached. 

HP announced that they will support Open- 
Mail 6.0 and 7.0 for five years, but that they 
will not be developing new versions or a re¬ 
placement package, http://www.iip.com 
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^ In the latest of a series of 

^ acquisitions, Red Hat has 
announced the purchase of 
Planning Technologies, Inc. for 
$47 million in stock. With this acquisi¬ 
tion, Red Hat adds to its payroll approx¬ 
imately 200 engineers from the Atlanta- 
based Planning Technologies. 

Planning Technologies specializes in 
infrastructure consulting for enterprise 
clients, service providers, and govern¬ 
mental agencies. The company was 
founded in 1992, and its client list in¬ 
cludes AT&T and Delta Air Lines. In¬ 
terestingly, PTI is not solely a Linux, or 
even open __ 

company; ~rPTI^ PLANNIN 

their focus V^“TECHN0] 
has histor¬ 
ically been on developing and deploy¬ 
ing network architecture. http://www, 
redhai.com 


AetiveSiate to Support Tcl 

The Tool Command Language, better known as Tcl (and usual¬ 
ly found in conjunction with it’s partner toolkit, Tk), has found 
a corporate supporter in ActiveState. Not only will the compa¬ 
ny be adding the language to its set of commercially supported 
tools, they will soon also agree to host the primary Tcl commu¬ 
nity Web site. 

Tcl/Tk had been supported by Scriptics, a company that 
focused on Tcl/Tk solutions. However, in May of last year, 
Scriptics changed its name to 
Ajuba Solutions and its focus 
to XML-based business-to-bus- 
iness solutions. 

Tcl is a popular scripting lan¬ 
guage in the open source com¬ 
munity, while Tk is a toolkit 
that allows programmers to create GUI applications with Tcl. 
ActiveState provides tools and support for open source pro¬ 
gramming languages, including Perl and Python (and now Tcl), 
on a range of platforms, http://www.activestate.com 


FDA IS liKely to become a reality 
this October. Sharp has announced that 
it will introduce a Zaurus PDA model 
based on the Linux OS in Europe and 
the US during the fourth quarter of 
this year. 

Sharp’s Mobile Systems Division 
Chief, Hiroshi Uno, is optimistic about 
the device’s success and says that the 
company intends to sell approximate¬ 
ly one million units by the following 
March and eventually grab 50 percent 
of the PDA market. 

According to Gartner, PDA sales will 
skyrocket between now and 2004, and 
Sharp is betting its share of the mar¬ 
ket on Linux and the large number of 
developers that are behind the Free 
Software OS. 

While there are several free distrib¬ 
utions and ports of Linux available that 
will run on a variety of PDA hardware, 
no commercial Linux-based PDA so¬ 
lutions exist currently. http://www. 
sharp-usaxom 


iiisi' ieUHS; fraiisiiis^ S@t is li&lis Umk 


aeveiopea meir own Linux aistriDuiion caiiei 

JamHETflY. 


Planning 
Technologies, Inc. 


Transmeta has been working on more projects than just their 
Crusoe processor and Code Morphing software. They have also 
developed their own Linux distribution called Mobile Linux, 

which works 
with the Cru¬ 
soe and Intel- 
based processors 
and is designed for use with Internet appliances such as Gate¬ 
way’s AOL Webpad. 

Mobile Linux was designed specifically to be used with disk¬ 
less appliances and therefore has lower memory requirements 
than Linux distributions that were designed for PCs and ser¬ 
vers. Mobile Linux also emphasizes power conservation and 
management. 

Of course, Transmeta has a not-so-secret weapon 
when it comes to developing new versions of Linux; 
they employ Linux creator Linus Torvalds. hup:// 
w vvw, fransnieta. cc rn. 
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Pro: 

>• Great GUI client 
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>■ No Debian packages 


Supported natfomis 

>Red Hat 6.1, 6.2, 7.0 

> SuSE 6.4, 7.0 

> Turbolinux 6.0.4 

> Mandrake 7.2 

> Caldera eServer 2.3 

System Requirmiienis 

Hard Disk 

>- 21 MB free space 

Package Manager 

> RPM 

AvailiAle Resources 

Oowntoads 

> Distribution-specific RPMs 

> Distribution-specific source code 

Tecli Support 

> Available separately (call for pricing) 


By Joe ""Zonker*" Brockmeier 

H ow much would you expect to 
pay for an easy-to-install, full-fea¬ 
tured SQL-compliant database? 
How about nothing? GreatBridge 
PostgreSQL is a great database 
package with all the bells and whistles 
that come in its high-priced brethren — 
but it’s open source. 

Both RPMs and source code are av¬ 
ailable for download, as well 
as an ISO image that comes 
complete with an installer. 
The distribution-specific ISO 
images are about 42 MB com¬ 
pressed, so they won’t take 
long to download with a rea¬ 
sonably fast connection. Ad¬ 
ditionally, there is an option 
to sign up for a free Great- 
Bridge PostgreSQL CD. 

We installed GreatBridge 
PostgreSQL from the RPMs 
onto a SuSE 7.0 system. The 
installation was painless, 
and PostgreSQL was up and running in 
less than twenty minutes (not includ¬ 
ing the time it took to download the 
RPMs and read the install instructions). 

Manuals and Tools 

The accompanying documentation is 
complete and is available both online 
and in printable PDF format. There are 
three manuals available on the site: an 
Installation Guide, a User’s Guide, and 
a Reference Guide. Unless you’re al¬ 
ready a PostgreSQL expert, you’ll prob¬ 
ably need all three. 

PostgreSQL also comes with a user- 
friendly GUI client called PgAccess. Pg- 
Access is a full-featured Tcl/Tk client 
that makes it easier to work with the 
database by handling everything from 
creating databases to adding users to 
creating queries. PgAccess allows you 
to create Tcl/Tk forms for data entry. 
If you’re more comfortable using 


SQL in a terminal environment, don’t 
worry. The psql program lets you in¬ 
teract with the database from a termi¬ 
nal-based front-end. We spent a little 
while with psql and decided that Pg¬ 
Access is more fun. Hardcore SQL 
maniacs may prefer psql but PgAc¬ 
cess spoiled us. 

PostgreSQL supports both TCP/IP 
and SSL connections. The Postgres 
postmaster program has to be explic¬ 
itly told to allow connections over 
TCP/IP, otherwise it assumes you only 
want to be able to connect through do¬ 
main sockets from the local machine. 
The first time we started PostgreSQL, 
we neglected to set these options and 
had to kill and restart the postmaster 
program. 

Minor DrawliaiA 

The only complaint we have about 
GreatBridge PostgreSQL is its lack of a 
distribution-agnostic download. While 
they do have tailored RPMs for the lat¬ 
est versions of the major RPM-based 
distros, if you’re using a distribution 
that doesn’t support RPMs, you may 
be out of luck. However, GreatBridge 
is only one of the organizations that 
works with PostgreSQL, so if you find 
yourself in this unlucky situation, you 
can still find vanilla source code for 
PostgreSQL elsewhere on the Internet. 

GreatBridge doesn’t make its money 
selling licenses to PostgreSQL or even 
by selling the CDs. It does ask for a lit¬ 
tle personal information when you 
download documentation, but there’s 
no charge for the PostgreSQL software 
itself. Instead, the company has cho¬ 
sen to make its money from technical 
support, consulting, and other services. 

GreatBridge PostgreSQL is a great 
package. If you’re looking for an SQL- 
compliant database for your Web site 
or any other project, you should down¬ 
load GreatBridge PostgreSQL and try 
it out. It won’t cost you a thing. 11 
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Internet Serving 

At Its Finest 


Build Your 

Internet Infrastructure 
with Penguin Computing™ 


SINGLE CPU WEB SERVER Starting At 
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► Slim 1U (1.75") form factor 
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► Up to 512 MB of PCI00 memory (2 DIMM slots) 

► Single integrated Ethernet port 

► Integrated 2-channel EIDE controller 
* Two low profile EIDE drive bays 


APPLICATION SERVER Starting At 

Relion 220 » $2293 


>2U (3.5") form factor 

' Single or dual Intel® Pentium® III processors up to 1.0 GHz 

• Up to 4 GB of PCI33 Memory (4 DIMM Slots) 

' Dual integrated Ethernet ports 

' Dual hot-swap power supplies available 

• Six low profile hot-swap SCA LVD drive bays 


DUAL CPU WEB SERVER Starting 

Relion 120 $2417 
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• Slim 1U (1.75") form factor 

• Single or dual Intel® Pentium® III processors up to 933 MHz 

• Up to 4 GB of PCI33 memory (4 DIMM slots) 

• Dual integrated Ethernet ports 

• Integrated Ultra160 SCSI controller 

• Two low profile hot-swap SCA LVD drive bays 


WORKSTATION 

Award-Winning Niveus 




■i'. 


Starting At 

$1183 


Fully Integrated Linux Workstation 

Dual Intel® Pentium® III processors or single AMD 

Athlon"” processor 

Up to 1.5 GB of PCI 00/ 133 memory 

Highly scalable with up to six 5.25" drive bays 

Wide array of multimedia devices and upgrades 




Buy Online: www.penguincomputing.com 

Or Call: 1-888-PENGUIN 


Tel: 415.358.2600 Fax: 415.358.2646 saies@pengumcomputing.com 















































REVIEWS 

Microlite BackupEDGE 7 $300 NO Real BacliHiiEDBE Hen 

http://www.microlite.com 


By Bill von Hagen 




Rating; 




Pros: 

Extended SCSI support provides 
network device backups 
Master backups can be restarted 
^ Creates crash recovery diskettes 


Cons: 

^ Backup format is proprietary 
^ No support for standard software 
compression (gzip), only internal 
software and hardware compression 



ClirseS: Microlite provides old-school backup. 

Sysiein Requlrenieiils 

CPU 

>- 386 MHz or better 
>■ 2.x kernel 

Backup Drive 

> SCSI or IDE tape drive 

Simoited Piatioims 

> AIX > Hewlett-Packard 

> Linux > SCO Unix 

> Solaris > UnixWare 


B ackups are a pain. They’re one of 
those odious and time-consuming 
necessities of responsibly manag¬ 
ing a computer system. If you do 
not do backups with some regu¬ 
larity, there will be nothing but old data 
around when a drive goes bad, and 
then you’ll be screwed. 

That’s where BackupEDGE from Mi¬ 
crolite Corp. comes into the picture. 
Microlite’s serious, long-term experi¬ 
ence on Unix platforms is obvious from 
the start; the “programs” that report on 
a backup’s overall success or failure are 
shell scripts, making it easy to integrate 
custom reporting and site-specific 
error code handlers. 

Backing Up 

According to its documentation, 
backups done by BackupEDGE 
combine, “...many of the best fea¬ 
tures of tar, cpio, and sysadmin...” 
Unfortunately, that statement leads 
to our biggest complaint with Back¬ 
upEDGE; while it may combine the 
best features of those products, its 
actual backup data is compatible 
with none of them. This makes 
BackupEDGE useful only if you 
plan to do all of your archiving and 
restoring using BackupEDGE. A 
better, platform-independent so¬ 
lution would include a compatibility 
mode, where tar or cpio could restore 
backups. 

Backups performed by BackupEDGE 
do support both software and hard¬ 
ware compression (assuming that your 
backup device supports these as well), 
and both can be switched off if desired. 
A good solution for platform-indepen¬ 
dent software compression is to pipe 
the backup output into gzip - 9. Per¬ 
haps this will be implemented in a fu¬ 
ture release. 

In the interest of being truly plat¬ 


form independent, it would be nice if 
BackupEDGE allowed for backups to 
any target filesystems, even across a 
network. This would allow backups 
performed with BackupEDGE on one 
system to be restored on another. Un¬ 
fortunately, this is not possible at this 
time. Currently, the only way to accom¬ 
plish this is to move all of your back¬ 
up devices to the target system, install 
BackupEDGE in demo mode there, 
and use this combination to restore 
your files. 


Some Problems 

The program’s user interface is pri¬ 
marily a curses-based GUI. However, 
some functionality (like the index- 
based “fast file restore”) is also avail¬ 
able in an X Window system version. 
We’d prefer to see the whole thing 
ported to the X Window system. Curs¬ 
es-based interfaces are definitely lean 
and mean, but they look sort of kludgy 
nowadays. We also had some problems 
getting BackupEDGE’s installer to work 
correctly from within an xterm win¬ 
dow. Arrow keys did not work deter¬ 
ministically in the installer (a serious 
problem for selecting options!) unless 
run from a command line outside of 
the X Window system. 

In short, BackupEDGE is a fine back¬ 
up and restore utility if you intend to 
do all of your backups and restores 
only on the same hardware. It supports 
standard Master and Incremental back¬ 
ups, and BackupEDGE mails a nice 
summary of its backup operations to a 
user-specified e-mail address. The pro¬ 
gram has an excellent track record on 
both Unix and Linux. However, if hard¬ 
ware and software compression isn’t 
mandatory or available in your com¬ 
puting environment, then you might 
find that the standard Unix tar-gzip- 
dump-restore utilities contain most of 
the same functionality that you will 
find in BackupEDGE. 11 
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REVIEWS 

Compaq ProLiant DL320 Server 
$2,541 Base, $4,434 as Tested 
http://wvvw.compaq.com/products/ 
servers/proliant-dl320/index.html 


Compaq’s Slender Beauties 

By Alan zeichick Compare and Contrast 




inaNutshei 


Rating: 


Pros: 

^ Takes up little room in server rack 
^ Inexpensive if purchased without 
a SCSI-based disk system 


Cons: 

► Only a single processor 
^ Single expansion slot 
limits scalability 


Compaq ProLiant DL360 Server 
$3,986 Base, $8,081 as Tested 
http://www.compaq.com/products/ 
servers/proliant-dl360/index.html 


MaNulsliel 


Rating: 


Pros: 

^ Takes up little room in server rack 
^ Lets you have up to 42 servers 
(84 processors!) in a single rack 
^ High-speed UltraS SCSI 
^ Hot-swappable drives 
^ Dual PCI slots 


Con: 

^ Nearly twice as 
expensive 
as the 
DL320 


hen it comes to servers, you 
can choose one of two paths. 
You can go for raw power, with 
four-way or eight-way proces¬ 
sors, gigabytes of RAM, dozens 
of hot-swap hard drives, and hot-swap 
PCI buses. Or you can go for density, 
stuffing as many servers into as small 
a space as possible. 

The ultimate expression of rack den¬ 
sity is the lU server, which stands at 
1.75" high. You can stuff 42 
of these puppies in¬ 
side a typical 
server rack. 
Most major 
hardware man¬ 
ufacturers offer 
lU servers, including 
Compaq, Data General, 
Dell, and IBM, but what 
prompted us to review these 
two entries from Compaq, the 
ProLiant DL320 and DL360, is 
that the company offers two dif¬ 
ferent models — they are outwardly 
quite similar but have distinct design 
philosophies. 

During the review process, both 
models performed spectacularly under 
Red Hat 7.0, our test distribution. It’s 
not a question of whether these are 
good servers for a high-density data 
center; the issue is which server fits 
the application best. If you’re running 
a Web server or file server, you should 
go with the less expensive DL320. 

If you are running an 
application 
server or per¬ 
haps a trans¬ 
actional data¬ 
base, then you 
should choose the 
higher-performance, 
higher-availability (and 
higher-priced) ProLiant 
DL360. 


The biggest differences between the 
servers can be found in two areas: pro¬ 
cessor and disk subsystem. The DL320 
has a single Pentium III processor and 
offers either ATA (also known as IDE) 
or Ultra2 SCSI-based disks; the tested 
model had a single 800 MHz Pentium 
III processor, 1 GB RAM, and two 10 
GB ATA/100 drives. The DL360, which 
looks outwardly quite similar, comes 
with one or two processors and Ultra3 
SCSI-based disks; the evaluated sys¬ 
tem had dual 800 MHz Pentium III pro¬ 
cessors, 1 GB RAM, and two hot-swap¬ 
pable 18 GB, 10,000 RPM Ultra3 hard 
disks. (Both servers also come in faster 
versions — up to 933 MHz for the DL- 
320 and 1 GHZ for the DL360.) 

When you get beyond those impor¬ 
tant differences, the machines start to 
look the same. Both have dual 10/100 
network interface cards, for example, 
which were immediately identified 
and properly configured by Red Hat 7. 
Both have lots of video RAM so that 
you can have a decent sized X Window 
console if you like administering a ser¬ 
ver via KDE or GNOME. Both are lim¬ 
ited to a single power supply. Both 
have a wide range of OS support; Com¬ 
paq officially supports not only Red 
Hat, but also SuSE 6.3 and 7.0, Turbo- 
linux Server 6, and Caldera eServer 
2.3. The company offers a preload of 
Red Hat 7, but we manually installed 
the OS onto both servers. 

What are these servers going to set 
you back? As equipped for this review, 
the DL320 has a list price of $4,434. 
The DL360 costs $8,081 — nearly twice 
the price. 

It’s All In the Details 

In many ways, the ProLiant DL320 is 
like a Compaq consumer PC squashed 
into a pizza box. With the single pro¬ 
cessor and dual-channel 100 Mbps ATA 


16 MAY 2001 


WWW.LINUX-MAG.COM 











,„<j 6*><'e 


pgRSON^ 


-. - ' ■"■ -.. - ■ 

frvv, SuSE Linux 7.1 Personal 

: Completely Simple 


SuSE Linux 7.1 Professional 
Simply Complete 

$6995 


Bring the revolutibh tb your desk 

Kernel 2.4 enhances the Linux performance through additional plug 
& play, USB, and power management features. 64 GB RAM support 
and scalability make SuSE Linux 7.1 the perfect choice for professionals. 

KDE 2.0.1, the easiest desktop ever - activate quickstart menus, 
your e-mail client, organizer, and media player with a mouse click 
- all built in and with drag & drop functionality. 

Many advanced features including: 

• GNU parted (create space for Linux by resizing Windows® partitions)- 

• SuSE YOU (YaST Online Update): keep your existing installations 
up-to-date and safe with the new SuSE tool for easy FTP updates. 

• Easy configuration of security features and firewall 

• Informative manuals for installation, configuration, and applications 


^ Professional solution consisting of 
7 CDs and a DVD: . : 

I • Office • Networking • Security 
^ Backup • Firewall • Routing • eCommerce 
Databases • FTP & Web Server 
! • Mail Server • Name Server 
'i Proxy Server-File Server 

Free installation support for 90 days 
by phone, fax, or e-mail 


More intuitive with no performance 
sacrifices: 

• Easy Internet access 

• StarOffices.i 

• Multimedia applications and games 

• SuSE Help, the integrated information sys¬ 
tem (all tips & tricks with one mouse click) 

Free installation support for 60 days 
by phone, fax, or e-mail 


Also available as 7.1 Update Package for $ 49.95 


Now with 
Kernel 
2.4 
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SuSE Linux 7.1 
has arrived. 




Order today! www.suse.com 
Or call us: 888 875 4689 


disk bus, that’s mainly what it is. Don’t 
underestimate a single processor ma¬ 
chine, particularly for lightweight tasks 
like file serving or simple Web serving 
(which isn’t too different from file ser¬ 
ving) or driving a sendmail system. On 
the other hand, some tasks — running 
an application server or Web site with 
Java servlets, a transaction database, 
acting as a Beowulf cluster, racking up 
a high score at SETl@home — should 
really have the dual-processor power 
of the DL360. 

What about the disk 1/0 subsystem? 
For the past ten years, it’s been “as¬ 
sumed” that a server uses SCSI hard 
drives and that desktops use ATA dri¬ 
ves. That made a lot of sense. Back 
when drives were flakey, the ATA bus 
(which means “AT Attachment”; it 
used to be called IDE, for “Integrated 
Drive Electronics”) poked along at a 
snail’s pace. But the latest revision of 
the ATA spec, ATA/100, zips along at 
100 Mbps — faster than Ultra2 SCSI’s 
80 Mbps. Given that only two hard 
drives can sit on an ATA bus (com¬ 


pared to 7 or 15 on a SCSI bus), a 100 
Mbps bus is more than adequate. 

Our only beef with the DL320’s ATA 
system is that the hard disks them¬ 
selves are slow. The DL320 we tested 
used the 10 GB Seagate Barracuda 
ST310216A drive, with a rotation speed 
of 7,200 RPM and 8.2 milisecond ac¬ 
cess time. By comparison, the 18 GB 
Ultras SCSI (160 Mbps) drives in the 
DL360 spin at 10,000 RPM and has a 
5.2 milisecond access time. For driving 
a database, you’re better off with the 
faster drives and the SCSI subsystem. 
But if the server is stuck in the Web 
server role, processing middleware, 
you should be happy with ATA. 

Another difference in the servers’ 
disk subsystems is that the DL360 in¬ 
cludes a hardware-based RAID control¬ 
ler, which can either span the two disks 
into a single logical volume or set up 
the drives with hardware-based mir¬ 
roring. If that’s important, then the 
DL360 is the only game in town. 

A final difference worth pointing out 
is in server expendability. The DL320 


has only a single PCI 64-bit 33 MHz 
expansion slot — we couldn’t see why; 
there’s plenty of room inside the chas¬ 
sis to stuff a second slot. But if you like 
gigabit Ethernet, want to put a SCSI 
card inside to drive an external tape 
array, or want to put the server on a 
Fibre Channel-based storage area net¬ 
work, you’ll be only able to pick one. 
By comparison, the DL360 has two 33 
MHz slots (one 32-bit and one 64-bit) 
and also includes an external SCSI 
port for a tape drive. 

Bonolii Line 

Both servers get the job done, though 
the DL360 is clearly a better machine, 
offering additional performance and 
scalability, albeit at a higher price. If 
your goal is to pack a lot of processors 
and OSes into a tight space, either ser¬ 
ver can do the job. With the DL320 
for lighter-weight tasks, and the extra 
oomph provided by the dual-proces¬ 
sor DL360, you’ll have a good combi¬ 
nation for most data-center tasks. IM 


SuSE, Inc. 

580 Second Street 
Oakland, CA 94607 
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learning a Script 

By Bill McCarty 


I t seems that one of the skills re¬ 
quired of an actor is the ability to 
memorize a script. I had assumed 
that learning a script is of greater 
importance to stage actors than film 
actors, because stage actors must de¬ 
liver their lines and follow their stage 
directions correctly the first time. How¬ 
ever, acquaintances that are in the bus¬ 
iness assure me scripts play a central 
role in both types of acting. 


Scripts of a somewhat different kind 
are important to Linux and Unix users. 
Scripts (sometimes referred to as “shell 
scripts,” since the scripting language 
is built into the shell) let you teach a 
computer new commands of your own 
design. By constructing scripts that per¬ 
form commonly used operations, you 
can reduce the tedium and effort these 
operations require. A thorough know¬ 
ledge of scripting is one of the key¬ 
stones of Linux mastery. 


A First Script 

With all the copyright disputes that 
have arisen lately, Fm surprised no¬ 
body has commented on Burger King’s 
ownership of the slogan “Have It Your 
Way.” That’s been the slogan of Linux 
and Unix developers since the begin¬ 
ning; if you don’t like how your sys¬ 
tem works, write a script to make it 
work your way. 


For instance, suppose you often use 
the w command to see which users are 
logged into a host (see Figure One ]. 

It’s difficult to see if a specific user 
is logged on, because the w command 
prints its output in no particular order. 
By writing a script, however, you can 
change this behavior. Using a text edi¬ 
tor, create a file named users with the 
following contents: 

w I sort 


Now, execute the file by issuing the 
following command: 

sh users 

The output will now resemble Figure 
T\vo (pg. 20), in which lines appear in 
an order governed by the user name. 

Okay, the heading line appears last 
in the output, but we’ll fix that in a 
moment. First, let’s look at how the 
script works. Essentially, typing the 
command sh users is no different 
than typing the command contained 
in the file w | sort. This command 
executes the w subcommand and then 
“pipes,” or sends, the w command’s 
output to the sort subcommand, which 
alphabetizes the w command’s output. 

You may reasonably object on the 
grounds that it’s almost as convenient 
to type w I sort as it is to type sh 
users. Fair enough; let’s fix that. Issue 
the following command: 

chmod u+x users 

Now you can obtain the sorted list¬ 
ing by merely typing the command 
. /users. That’s easier than typing w 


Bl constructing scripts that perform commonii osed operations, 
lou can reduce the tedium and effort these operations regnire. 


Hgure One: Output of the w Comnianii 

[bmccarty@home bmccarty]$ w 


10:06am 

up 149 

days, 22:01, 

38 users, 

load 

average: 0. 

o 

o 

o 

o 

o 

0.00 

USER 

TTY 

FROM 

LOGIN® 

IDLE 

JCPU 

PCPU 

WHAT 

dglyer 

pts/0 

faedhcpll? 

ThulOam 

23:54m 

0.73s 

O.Ols 

/usr / local /bin/pdme 

sniper86 

pts/25 

- 

10:05am 

1.00s 

0.07 s 

0.05s 

vi .te/aliases.ire 

enigma 

pts/22 

- 

7:33am 

35:18 

60.41s 

60.41s 

ire -c#tech enigma 

philpi 

pts/31 

- 

9:13am 

5:34 

0.30 s 

0.30s 

pine 

mccartyp 

pts/21 


9:55am 

11:02 

48.52s 

48.51s 

pine -i 

enigma 

pts/1 


7:33am 

35:40 

1.16 s 

1.13s 

ire -c#linux enigma 


etc. 
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Microway Delivers Custom Linux 
Workstations and Beowulf Clusters 
for Linux Professionals! 


500 MHz — 1 GHz Pentium HI or Quad Xeon 
500 MHz—-1 GHz Dual or Single Athlon 
Beowulf Cluster 

Distributed Memory Parallel Proeessing 

Myrinet Gigabit Ethernet or Dolphin Wulfkit 
High Speed, Low Latency Backplanes 

RAID 

Satisfied customers have purchased Microway products since 1982. Our cost effective Linux 
solutions have been chosen by universities, government research labs and ISPs worldwide 
iiliiiippg i K since 1996. Over the years Microway brand systems have become famous for their quality and 
i|i|f||i|||j^ ' I price/performance. Simultaneously, our Technical Support staff earned a reputation as one of 
B industry. This means you can count on our experience to 

configure a UNIX or Linux workstation or Linux Beowulf cluster solution that is ideally suited 
Jiiitii. iPiB to your specific problem. This is why Microway was chosen by Los Alamos National 

Laboratory to maintain and upgrade their 144-node Alpha Avalon cluster. It is ^ 

also why both the University of Wisconsin and Rockefeller University chose 
Microway to build their T0O-node dual Pentium III clusters. In addition to ^ 
being an Intel Product Developer and AMD Athlon OEM, Microway is Alpha Processor, Inc.'s 
Top North American Channel Partner. 

"To find a successful supplier of Linux solutions there are three things that you should 
know: One, the supplier must be proficient in Linux, a master of understanding Linux's 
superiorities; Two, the supplier must have a clear passion for hardware technology; Three, 
if you found a supplier that knows both Linux and understands hardware 
solutions, congratulations you have found Microway! When it comes to Linux and high 
performance, there's only one way, and that's Microway!" 

— Bruce Faust, founder of DigitalScape and Carrera Computers 

Microway custom configures Linux, NT and UNIX workstations, clusters and servers plus state 
of the art RAID systems. If you need a quality product that is fine tuned and built to last, from 
a company that will be around to support you for years to come, Microway 

The Number One Choice. 

Find out why over 75% of Mlcroway's sales come from — 
repeat customers. Please call 508-746-7341 for a technicaL^^^^^^^^^^^^^ ^ 
salesperson who speaks your language! 

visit us at microway.com g 
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Dual Alpha UP2000+ 
833 MHz, 8MB Cache in RuggedRock™ 
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36 Processor, Dual Pentium III 
Beowulf Cluster with Myrinet and MPI 


Research Park Box 79, Kingston, MA 02364 
508-746-7341 • info@microway.com 









































































Figure iteo: Sorted Output of the w Command 


[bmccarty©home bmccarty]$ w 
10:06am up 149 days, 22:01, 

38 users. 

load 

average: 0.00, 

o 

o 

o 

0.00 

dglyer 

pts/0 

faedhcpll? 

ThulOam 

23:54m 

0.7 3s 

0.01s 

/usr/local/bin/pdme 

enigma 

pts/22 

- 

7:33am 

35:18 

60.41s 

60.41s 

ire -c#tech enigma 

enigma 

pts/1 

" 

7:33am 

35:40 

1.16s 

1.13s 

ire -c#linux enigma 

mccartyp 

pts/21 

- 

9:55am 

11:02 

48.52s 

48.51s 

pine -i 

philpi 

pts/31 

- 

9:13am 

5:34 

0.30s 

0.30s 

pine 

sniper86 

pts/25 

_ 

10:05am 

1.00s 

0.07s 

0.05s 

vi .te/aliases.ire 

USER 

TTY 

FROM 

LOGIN© 

IDLE 

JCPU 

PCPU 

WHAT 


I sort, isn’t it? Moreover, if you put 
the users file in a directory that’s con¬ 
tained in your PATH environment var¬ 
iable, you can simply type users. 

If this hasn’t convinced you of the 
value of scripts, consider that scripts 
can contain multiple commands. Let’s 
demonstrate by moving the pesky 
heading line from our last example to 
the top of the output, where it belongs. 
To do this, we simply modify our users 
script to have the contents shown in 
Figure Three. 

If you execute this script, you’ll see 
output that looks just like the original 


output of the w command, but the out¬ 
put appears in sorted order. In partic¬ 
ular, the heading appears at the top of 
the output. How is this done? The 
echo command displays the desired 
heading, and the -h flag of the w com¬ 
mand suppresses the heading that 
command otherwise displays. 

Why stop here? Let’s continue by 
creating a script that provides still more 
useful output. 

Consider Figure Four. This super¬ 
charged descendant of the virile, yet 
undistinguished, w command displays 
the total number of current users as the 


final line of its output. This is accom¬ 
plished by using the echo command to 
display an appropriate label and then 
using the w command a second time, 
piping its output to the wc command, 
which counts and displays the number 
of lines in its input. Since the wc com¬ 
mand receives one line of input for 
each user, the result is a count of 
logged-in users. As you can see, Linux 
is truly a “Have It Your Way” operating 
system. 

Script ArgumcRts 

In the entertainment busi¬ 
ness, script arguments are 
bad news, because they can 
result in the loss of millions 
of dollars. However, in the 
Linux world, script argu¬ 
ments are good news, be¬ 
cause they increase the 
flexibility of scripts. 

In the context of Linux, 
the word argument doesn’t 
refer to a dispute. Instead, it 
refers to a value that modi¬ 
fies the operation of a script, 
allowing you to create more 
flexible scripts. Suppose you 
are interested in running the 
w command in order to see 
if your friend, whose userid 
is smper86, is logged on right 
now. The script in Figure Five 
would do the job. 

As before, the w command 
lists the logged-on users. 
Here, the grep command 
filters the resulting output, 
discarding all lines that don’t 
contain the text sniper8 6. 


ngure Three; Fixing the Heading 

echo "USER TTY FROM LOGIN® IDLE JCPU PCPU WHAT" 

w -h I sort 


Fignre Fonr; (Granting the To^i Users 

echo "USER TTY FROM LOGIN© IDLE JCPU PCPU WHAT" 

w -h I sort 

echo -n "Total current users: " 
w -h I wc -1 


Fignre Five; Hnding a Specific User 

echo "USER TTY FROM LOGIN© IDLE JCPU PCPU WHAT" 

w I grep sniper86 


Fignre SiX; Finding Any User 

echo "USER TTY FROM LOGIN® IDLE JCPU PCPU WHAT" 

w I grep $1 
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by Knox Softiuare 



^ Arkeia®. The Linux backup solution you need 
i - to keep your mission-critical data protected 



Arkeia® 4.2 provides a robust and 
reliable Linux-based solution for 


your network backup needs. 

• It supports over 30 major operating 
systems and works on over 100 
different storage devices. 

• It offers great speed and security. 
By using multi-flow technology and 

client side compression 
Arkeia® is capable of 
backup speeds that often 
exceed the network's 


rated speed. Its unique 
transaction engine allows 
multiple backups and 
restores to be performed 
simultaneously with total 
reliability. 

• It features a queuing 
facility which allows backupsto be 
launched when convenient rather 



than when resources are available. 

With over 30,000 users worldwide 
and more than 150 new companies 
choosing Arkeia® every month to 
protect their mission-critical data, 
Arkeia® is the de-facto standard for 
network backup with Linux. 



Visit our web site atwww.arkeia.com 
and benefit from a free 30 day 
demo of the full 
Arkeia® 4.2 
Professional 
Version. 


A free version of Arkeia® is also 
available for home and small 
business use to protect data on one 
Linux server and two clients. 



Arkei(f... 

Data protection for the real world. 
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Rgure Seven: The Sontacts me 

editors@linux-mag.com editors 

linuxmag@neodata. comPsubject=CustcmerServiceQuery&GG=subs@linux-mag. com service 

bmccarty@apu.edu Bill McCarty 

bob@linux-mag.com Robert McMillan 

aefrisch@lorentzian.com Aeleen Frisch 

perlow@hotmail.com Jason Perlow 

tech@linux-mag.com Drew Streib 

merlyn@stonehenge.com Randal L. Schwartz 


If you placed this script in the file 
friend, you could conveniently check 
to see if sniper86 is logged on. But sup¬ 
pose you have two friends. You could 
create a second file, perhaps named 
friendZ, to check whether your other 
friend was logged on. However, if you 
are sociable and have many friends, 
this approach quickly becomes tedi¬ 
ous. Fortunately, there’s a better way. 

Consider Figure Six (pg. 20). Instead 
of containing the userid of one of your 
friends, this script contains the shell 
variable $1, which stands for the first 
argument provided by the user when 
the script is run. To see what this 
means, execute the script as follows: 

friend sniper86 

The command argument sniper8 6 
is bound to the shell variable $1 so 
that the script behaves as though its 
second line was w | grep sniper86 
rather than w l grep $1. 

What’s cool about using an argu¬ 
ment is that you can invoke the script 
in a nearly infinite variety of ways, ac¬ 
commodating the possibility of a 
practically infinite number of friends. 
For example, you can check whether 
enigma is logged on by issuing the 
command friend 


tiple words, script authoring can be¬ 
come a tad tricky. For example, con¬ 
sider the data file shown in Figure Sev¬ 
en. This file, named contacts, contains 
e-mail addresses and names of Linux 
Magazine contacts. 

To help you search the file, you 
might choose to create a script named 
findcontact, resembling the following: 

grep $1 contacts 

Better yet, you might include the - i 
flag so that grep ignores case distinc¬ 
tions. Also, you might use an absolute 
path to specify the location of the con¬ 
tacts file so that using the findcontacts 
command doesn’t require you to 
change the current working directory 
to the one containing the contacts file: 

grep -i $1 /root/contacts 

To search for a contact, you might 
issue a command such as this: 

findcontact bill 

The command displays the line, or 
lines, in the contacts file that contain 
the text hill, without regard to case. In 
this example, it would display the line 


showing the e-mail 
address of Bill Mc¬ 
Carty. 

That’s well and 
good, but suppose 
that someone with 
the name of Bill 
McMillan joins the 
Linux Magazine 
team, as shown in 
Figure Eight Now 
the findcontact bill command 
yields two lines of output rather than a 
single line. Again, that’s well enough. 
However, suppose you’re interested 
only in the contact information for the 
newcomer, and so you issue the fol¬ 
lowing command: 

findcontact Bill McMillan 

To our disappointment, the com¬ 
mand will display two lines of output 

— the line for Bill McCarty and the 
line for Bill McMillan. The reason for 
this is that you’ve actually sent two ar¬ 
guments to the findcontacts command 

— Bill and McMillan. However, the 
script will only accept the first argu¬ 
ment ($1). That is not exactly having 
it our way, is it? 

To overcome the problem, you might 
attempt to enclose the arguments in 
quotes, converting them to a single ar¬ 
gument consisting of two words: 

findcontact "Bill McMillan" 

Unfortunately, this fix doesn’t go 
quite far enough. When the shell vari¬ 
able $ 1 in the line 

grep -i $1 /root/contacts 


enigma. No long¬ 
er is a special ver¬ 
sion of the script re¬ 
quired for each of 
your friends. 

To Quote or 
Not to Quote 

When arguments 
can consist of mul- 


ngure Eight: The Revised Contacts Hie 

editors@linux-mag.com editors 

linuxmag@neodata. com?subj ect-CustomerServiceQuery&cc=subs@linux-mag. com service 

bmccarty@apu.edu Bill McCarty 

bob@linux-mag.com Robert McMillan 

aefrisch@lorentzian.com Aeleen Frisch 

perlow@hotmail.com Jason Perlow 

tech@linux-mag.com Drew Streib 

merlyn@stonehenge.com Randal L. Schwartz 

nobody@linux-mag.com Bill McMillan 
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When NETWORK APPLIANCE Users Switch 
To RAIDZONE OpenNAS, How Do They Spend 
Their Savings ... Cars? Yachts? Trips? 


RAIDZONE OpenNAS 1TB $22,650 

Mercedes SLK320 $40,100 

Vancouver 32 Yacht $62,000 

QE2 104-day World Cruise $57,600 


Network Appliance F760 

1 TB 

$205,945 


$182,350 


Say you need a Terabyte of fast, reliable network storage for 
Windows or NFS. You could buy the NetApp 760 and be quite 
satisfied. Or, you couid buy the RAiDZONE OpenNAS RS2000L, 
the Mercedes SLK320, the 32- 
foot saiiboat, and the 104-day 
round-the-worid cruise (in a 
deluxe outside cabin), and 
stili have $23,000 left over. 

Which wouid be more than 
enough to buy a second TB 
of reliable RAIDZONE storage 
for your travel videos. 

Come on people, this isn’t 

rocket science. When you 
choose a RAIDZONE storage 
solution, you join our customer 
list alongside Boeing, Lockheed 
Martin, Motorola, Conexant, 

Palm Inc., Cisco Systems, The 
Dana-Farber Cancer Institute, 

Baylor College of Medicine, 

Komatsu Mining Systems, and 
hundreds of others. 


RAIDZONE OpenNAS 
RS2000L File Server 
$22,650 

15 hot-swappable, 80 GB Ultra 
ATA/100 drives 

RAIDZONE disk array, with hot 
spare, hot swap, RAID 5 and 
on-the-fly rebuild 
Dual high performance 933 MHz 
Pentium III CPUs, 256MB RAM 
Gigabit & 100MBit NICs installed 
Complete browser-based remote 
administration interface 
Supports NFS, Windows 
(SMB/CIFS) and Apple clients 
Includes full 1 year warranty, 
with 3 years on the disks 


Every one of these industry leaders has 
purchased a RAIDZONE OpenNAS 
storage solution. A few of them have 
already installed over 10 Terabytes of 
RAIDZONE storage, with more to come. 
Not surprisingly, none of them has had 
any problem deciding what to do with the 
large amounts of money they’ve saved. 

A full line of RAIDZONE OpenNAS file 
servers Is available. If your storage needs 
are modest, you can choose the 200 GB, 
5 -disk desktop cube. At the high end, we 
have a 45-disk, 3 Terabyte rackmount 
server with dual Gigabit Ethernet NICs. 
And every size in between. All designed 
so that you can get the amount of reliable, 
redundant storage you’ll need tomorrow 
at a price you can afford today. 


For more information, or to order 
oniine, piease visit our Web site: 

www.raiclzone.com 

or give us a call at: 

1-800-388-1896 
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Computer, Inc. The information about Network Appliance price and features is from a quotation valid on November 9, 2000, and is subject to change at any time. 
























is replaced by "Bill McMi 11 an ", the script 
operates as though the line had been written as 

grep -i Bill McCarty /root/contacts 

because the shell drops the surrounding quotes 
when it substitutes the value of the $1 vari¬ 
able for its name. The result is that the grep 
searches the files McCarty and /root/contacts 
for the text Bill. Of course, the file McCarty 
probably does not exist, so the output consists 
of both lines from /root/contacts containing 
the text Bill. This is not what’s wanted. 

Fortunately, the fix is simple; both the com¬ 
mand-line argument and the script itself must 
be properly quoted. Write the script like this: 

grep "$1" /root/contacts 

And, here’s how to execute it: 

findcontact "Bill McMillan" 
nobody@linux-mag.com Bill McMillan 

Although it required some ingenuity to get 
here, the script now behaves as desired. Lin¬ 
ux’s reputation as a have-it-your-way operat¬ 
ing system is secure. 

Tile Long and Winding Hoad 

This column, as usual, has scarcely touched 
the surface of its topic, shell scripts. Among 
the most useful shell features not covered are 
multiple arguments, more sophisticated rules 
and methods of quoting arguments, environ¬ 
ment variables, conditional execution, loop¬ 
ing, backquoted expressions, and signals. Fu¬ 
ture Newbies columns will touch on these 
stepping-stones to Linux mastery. 

The topical development of this column 
was inspired by Chapter Three of my favorite 
Unix book, Brian W. Kernighan’s and Rob 
Pike’s The Unix Programming Environment 
(Prentice-Hall, 1984). If you’re rushing down 
the road to Linux gurudom, you need to get 
and read this book. It’s a terse, and therefore 
somewhat tough, read that demands concen¬ 
trated attention, but your efforts will be re¬ 
warded many times over. Until next month, 
happy scripting! 


Bill McCarty is an associate professor at Azu¬ 
sa Pacific University. He can be reached at 
bmccarty@apu.edu. 


RmiraaiN^ 

As everyone knows, the real-life actors we mentioned at the beginning of 
this article often have trouble finding a good script. In fact, some actors 
have been known to resort to writing scripts especially designed to show¬ 
case their talents. Okay, so maybe we’re stretching the actor analogy a 
bit thin here, but the point is that you too can write your own scripts. 
However, to be able to write effective scripts, you’ll need to employ a 
wide-ranging repertoire of Linux commands. The table below summa¬ 
rizes some Linux commands that are often used in scripts. Consult the man 
pages or other documentation to learn more about these commands. 


Important Commands Often Used in Scripts 

at Execute a command at a specified time 

cat Display contents of a file 

chmod Change file permissions 

comm Compare files 

cp Copy files 

df Display disk space usage of filesystems 

diff Compare text files 

du Displays disk space usage of directories 

echo Display text 

eval Evaluate an expression 

grep Find strings 

kill ■ Terminate a process 

Ipr Print data 

less Page through a file 

Is List file information 

mail Send a mail message 

mkdir Create a directory 

mv Move a file or directory 

nice Set process priority 

nohup Run a command immune to hang-ups 

od Display file contents in octal and other formats 

passwd Set a user’s password 

pr Format data for printing 

ps Display process information 

rm Remove a file 

rmdir Remove a directory 

sh Launch a shell 

sleep Pause a process 

sort Sort data 

spell Check spelling 

tail Display last lines of file 

time Time the execution of a script 

times Displays CPU time used 

uniq Eliminates duplicate data 

w Displays logged in users 

wait Waits for child processes to terminate 

wc Counts characters, words, and lines 

who Displays logged in users 
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IN THE TRENCHES 

Unux: The Dawn of a New Day 



By Ransom Love 


ith the recent downturn in the 
! economy and the drop in Lin- 
! ux companies’ share prices, an 
I uninformed observer might be- 
f lieve that the sun is setting on 
Linux. They would be wrong. Unfor¬ 
tunately, the expectations that had pre¬ 
viously been set for Linux are analo¬ 
gous to parents expecting that their 
teenager successfully complete college 
before graduating from high school. 
Few, if any, possess the maturity to 
make that jump. 

The failures teenagers encounter as 
they strive to cross the chasm between 
adolescence and adulthood do not di¬ 
minish their potential in our eyes. In 
fact, we applaud and encourage them 
to continue to try again, because we 
know that those who are the brightest 
and most capable will have more fail¬ 
ures before they reach their potential. 

As a father of seven children (three 
of whom are teenagers) and a founder 
of Caldera, I know whereof I speak. 
The Linux industry is as complex and 
difficult to understand as a teenager. 
The challenges facing Linux have noth¬ 
ing to do with its potential 
and everything to do with its 
maturity. With that in mind. 

I’d like to make five sugges¬ 
tions for the Linux industry: 

> Learn to honestly evaluate 
successes and failures 

> Uphold standards 

> Develop and/or embrace 
mature business channels 
outside of retail 

> Specialize 

> Seek compatible compan¬ 
ions that will help Linux 
mature faster 


Evaluate Successes and Failures 

The Linux industry and the Open 
Source development model have had 
tremendous successes that have 
changed the information technology 
landscape for good. The Open Source 
software development model facili¬ 
tates collaboration and innovation in 
an unparalleled manner. Linux, as a 
technology, has matured much faster 
in its development than any other tech¬ 
nology or operating system. However, 
Open Source is not without its prob¬ 
lems — even as a development model. 

An Open Source model does not pro¬ 
vide a complete road map of where the 
technology is going. The outcome and 
timing of Open Source development is 
much less predictable. Open Source is 
akin to the ideal sandbox for a devel¬ 
oper — lots of technology to play with 
and no one giving assignments or 
deadlines. This is great for develop¬ 
ment but not great for business. 

Open Source has made a significant 
contribution to the way software is and 
will be developed. It has proven to be 
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a method of development worthy of 
further review and refinement. We can 
mature the model by developing road 
maps and improving timelines. 

While the Open Source development 
model shows great potential, the busi¬ 
ness model needs some additional 
work. If we want to support the devel¬ 
opment model of “free” software, we 
must come to realize that someone has 
to make money. If the Linux providers 
cannot become profitable, the only 
companies who will continue to invest 
in Linux will be those with a differing 
agenda. Their income will be derived 
from sources other than Linux itself, 
and their primary allegiance will be to 
those other sources of revenue. 

Linux providers must be free to ex¬ 
periment with business models that 
allow them to earn a profit. The Linux 
market must mature into a real in¬ 
dustry or it will be relegated to acting 
as a catalyst for existing industries like 
hardware or software. The community 
must come to terms with the fact that 
the Linux providers need to make 
money in order to stay healthy. With¬ 
out healthy Linux providers, 
we run the risk of returning to 
the bad old days of fragment¬ 
ed Unix, and we potentially 
allow the underlying hardware 
architecture to drive the plat¬ 
form and differentiation. 

Uiiliolil Standanis 

So, what is needed for Linux to 
mature as an alternative busi¬ 
ness platform? Well, continu¬ 
ing with our maturing teen¬ 
ager example — young adults 
eventually come to realize that 
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laws or standards are for their benefit, 
not to simply create hindrances or re¬ 
strictions. In much the same manner, 
Linux needs to have a standard refer¬ 
ence platform and distribution that all 
developers can write to. 

The industry has talked about adopt¬ 
ing a Linux Standard Base (LSB), but 
the early success of Linux has created 
obstacles to its adoption. Every Linux 
provider felt that they had an oppor¬ 
tunity to become the dominant plat¬ 
form, and the tight development cycles 
that are required to remain competitive 
in the retail space, combined with the 
average developer’s insatiable desire to 
have the latest and greatest technolo¬ 
gy, fueled a self-feeding retail frenzy. 

Deveiop and Embrace Mature 
Business Channels 

This leads to the next point. Just as a 
teenager must branch out beyond his 
parents in order to integrate the know¬ 
ledge and experience of others, Linux 
must branch out from its retail roots 
and develop mature business channels. 
Mature business channels like Value 
Added Resellers (VARs), Consultants, 
and Original Equipment Manufactur¬ 
ers (OEMs) are critical to the business 
customer. These specialists provide to¬ 
tal solutions for their clients. No one 
buys an operating system — they buy 
a solution to their business needs. 


Because we live in a global economy, 
these channels and the companies that 
support them must be global. Having 
regional Linux companies is a major 
headache for business customers as 
well as for major application and hard¬ 
ware vendors. While many large appli¬ 
cation and hardware providers support 
multiple regional Linux providers, most 
smaller businesses cannot. 

Consequently, a Linux provider must 
be able to offer a global infrastructure 


for support, marketing, and sales. To 
build a global infrastructure requires 
tremendous resources, time, and cap¬ 
ital. With money tight, the current mar¬ 
ket is forcing the maturation and con¬ 
solidation of suppliers. 

Snecialiie 

Just as a teenager must seek special¬ 
ized training, Linux providers must 
begin to focus and specialize. Rather 
than view each other as competition, 
we can partner in key areas that would 
be beneficial to the industry at large. 
Since there is little or no money in a 
base distribution of Linux, we should 
all provide an LSB-compliant distribu¬ 
tion. Specialization can then come 
from the markets we choose to support 
or the product areas above the operat¬ 
ing system in which we develop intel¬ 
lectual property. 

Seek Cempatible Companions 

Finally, when we are young, we feel 
that we do not need anyone’s help to 
achieve our goals. We have no fear. 
When we get a little older and wiser, 
we realize that partnering with others 
can provide tremendous growth, com¬ 
fort, and enjoyment. There are those 
in the Linux community who believe 
that they can do it all themselves. 
However, they are unrealistic. 


With all of the investment capital 
that has been poured into it, and with 
all of the media interest surrounding 
it, there is tremendous pressure on 
Linux (as a technology and a business 
model) to mature much faster than 
may be realistic. 

At Caldera, we believe that unifying 
SCO Unix with Linux is a way of 
achieving that maturity in an acceler¬ 
ated time frame. SCO Unix as a tech¬ 
nology has test suites, application pro¬ 


gramming interfaces, tools, and infra¬ 
structure that would be very compat¬ 
ible with, and complementary to, Lin¬ 
ux. This unified system will enable 
application developers and business 
customers to more fully embrace and 
deploy Linux into the mainstream bus¬ 
iness back office. There is clearly a 
trend in the industry of traditional Unix 
providers integrating Linux with their 
current offerings. The Linux industry 
should embrace these groups. 

There are things in the Unix indus¬ 
try that need to change, and there are 
things in the Linux industry that need 
to change. However, their marriage 
could result in the most reliable, scal¬ 
able, open, and useful technology plat¬ 
form the industry has ever known. 

My greatest joy as a father has come 
from watching my teenagers, in both 
their failures and triumphs, take on the 
additional challenges of adulthood. For 
those who conclude from my analogy 
that they should wait to embrace Linux 
until it matures, 1 issue this challenge. 
If you wait, you may be left behind. 
Linux has grown and matured faster 
than any other operating system plat¬ 
form in history. Many of the issues 
that I raise in this piece are being ad¬ 
dressed even as 1 write these words. 

Like youth itself, Linux is fresh. The 
development model is new and intri¬ 
guing. The business model is not yet 
fully formed, but this provides oppor¬ 
tunity. Linux is a “disruptive” technol¬ 
ogy; it has and will continue to change 
the information technology world. 
More importantly, like the Internet 
itself, Linux will change the way we 
do business, the way we develop and 
deploy technology, and the way we 
package and deliver applications and 
business solutions. 

Get to know this teenager called Lin¬ 
ux and you will be richer and wiser, 
financially and personally. Get to know 
Linux and see the potential for change 
in our industry. Linux is the smart al¬ 
ternative, the dawn of a new day. 


Ransom Love is CEO of Caldera Linux 
Systems, a publicly-held Linux distrib¬ 
ution and services company. 
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SMB, the Server Message Biock Protocol, is the most 
prevalent filesharing protocol on the planet for a 
very simple reason — it ships with every Microsoft 
Windows system and, like it or not, Windows still 
owns the desktop. Windows is also very common as a 
server platform In corporate networks. Not content 
with those markets, Windows is now finding its way 
into all sorts of new places, including embedded 
systems, palmtops, and consumer toys. As Windows 
moves onto new platforms, SMB does too. 
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O pen source operating systems like Linux have been 
speaking SMB for quite a while now thanks to SAMBA, 
the well-known open source SMB Server suite. SAMBA, like 
Windows server products, is primarily a back-room tool. It 
runs on systems that are mounted in racks or stuck onto 
shelves in locked server rooms where only the geeks are 
brave enough to go. If Linux is going to move out of the 
datacenter and onto the corporate desktop (not to mention 
homes, hand-helds, cars, etc.), then Linux developers are 
going to need a working knowledge of SMB — the native 
language of the Microsoft Network Neighborhood. 

In this article, we’ll look into SMB’s history and architec¬ 
ture, as well as how its components work together. You’ll also 
find a list of open source projects that aim to make it easi¬ 
er to add SMB support to Linux applications. 





SMB was originally intended to run over a proprietary net¬ 
work system co-developed by IBM and a company called 
Sytec. In a moment of obvious inspiration, this system was 
dubbed “PC-Network.” It had no support for routing and 
could only handle a maximum of about 80 nodes. It was 
truly LAN-locked. 

PC-Network was a broadband LAN product consisting of 
network cards, cables, and a small device driver known as 
NetBIOS (Network Basic Input/Output System). The original 
PC-Network hardware is long gone, having been replaced 
by Token Ring and then Ethernet. Unfortunately, lots and 
lots of software was written for use with the NetBIOS Appli¬ 
cation Programmer’s Interface (API), so, even though the 
PC Network hardware is no longer in use and the NetBIOS 
device driver is no longer needed, the NetBIOS API has 
remained as a living artifact. 

Instead of moving away from NetBIOS and letting it die 
an honorable death, several vendors implemented the Net¬ 
BIOS API on top of other protocols, including DECnet, IPX/ 
SPX, SNA, and TCP/IP. NetBIOS over TCP/IP is often called 
NBT and has become the preferred NetBIOS transport. The 
workings of NBT are described in two Internet Engineering 
Task Force (IETF) Request For Comment (RFC) documents, 
RFClOOl and RFC1002 (known collectively as Internet Stand¬ 
ard #19). NBT is pictured in Figure One. 



The SMB protocol was designed to run on a PC-Network 
LAN, using the NetBIOS API to send and receive packets. 
This did not change until the release of Windows 2000 
(W2K), the first version of Windows to support SMB pack¬ 
et transport over TCP/IP without NetBIOS encapsulation. 
Even so, W2K includes NBT support to maintain compati¬ 
bility with its predecessors. SMB over TCP/IP is shown in Fig¬ 
ure 'Ruo. 

SMB was originally developed by Intel and Microsoft in 



Figure One: NetBios running over TCIP/IP. 


the early 1980s and has been the core of DOS and Windows 
filesharing ever since. Some time around 1996, as part of the 
buildup to W2K, Microsoft executed a Marketing Upgrade on 
SMB and renamed it CIFS, or Common Internet Filesystem. 

CIFS enables the sharing of directories, files, printers, and 
other cool computer stuff across a network. To make use of 
these shared resources you need to be able to find and 
identify them; you also need to control access so that unau¬ 
thorized users can’t fiddle about where they aren’t allowed. 
This means there is a hefty amount of administration to be 
managed, so CIFS filesharing comes with an entourage. 
There are protocols for service announcement, naming, auth¬ 
entication, and authorization. These are separate but inter¬ 
twined. Some are based on published standards, others are 
not; most have changed over the years. These days, the term 
“CIFS” is most often used to refer to the full suite, while 
“SMB” is typically used when discussing the filesharing 
protocol itself. 

In 1997, Microsoft submitted draft CIFS specifications to 
the Internet Engineering Task Force (IETF). Those drafts 
have since expired, but there is an effort underway by the 
Storage Network Industry Association (SNIA) to revive and 
overhaul them outside of the IETF process. 



Because of its heritage, the CIFS suite can be a bit awkward. 
Most of the silliness exists at the NetBIOS layer because, as 
we have already explained, NetBIOS is an anachronism. 



Figure Two: SMB running over TCIP/IP. 

















































































NBT is an implementation of the NetBIOS API on top of 
TCP/IP, but what RFC 1001 & 1002 actually describe is a 
system for emulating NetBIOS-based PC-Network LANs over 
a routed IP inter-network. This is critical to understanding 
the workings of NBT — it is a virtual LAN system. The nodes 
in a CIFS filesharing network are connected to an imaginary 
wire by imaginary network adapters. It’s all make-believe. 
There are three key parts to NBT. These are: 

> the Name Service 

> the Datagram Distribution Service 

> the Session Service 

The Name Service handles NetBIOS names (the address¬ 
es used on the emulated PC-Network LAN). The Datagram 
Distribution and Session Services carry data between the 
nodes on the virtual PC-Network LAN. 



Each NetBIOS name is a communications end-point, repre¬ 
senting an application or daemon that is waiting to hear 
from other applications or daemons across the virtual wire. 
The Name Service keeps track of which names are in use 
at which IP addresses, thus allowing the underlying IP net¬ 
work to find the nodes and transport NetBIOS messages 
between them. The Name Service runs on UDP port 137. 

There are two kinds of names — group and unique. Group 
names can be shared so that datagrams can be multicast to 
all members of the group. In contrast, only one instance of 
a unique name may be registered at a time within a virtu¬ 
al PC-Network LAN. 

The Name Service has two modes of operation — broad¬ 
cast and point-to-point. In broadcast mode, names are reg¬ 
istered, queried, and eventually released by sending UDP 


broadcasts to port 137. It’s sort of like calling out, “Yo! Any¬ 
body here named RUGRAT?” in a crowded room. If there is 
a RUGRAT in the room, you would expect an answer like, 
“Yeah, here I am.” 

Point-to-point mode is used to cross IP subnet boundaries. 
Since IP broadcasts are typically limited to local IP subnets, 
a special server called the NetBIOS Name Server (NBNS) 
must be used to coordinate and manage the names in use 
on a given NBT virtual LAN. All registrations, queries, and 
releases are sent directly to the NBNS, which keeps the 
name-to-IP mappings in a database. Microsoft’s NBNS im¬ 
plementation is called WINS (Windows Internet Name Ser¬ 
vice). The term WINS is now commonly used instead of 
NBNS, but we will be pedantic and stick with the latter. 

It is possible, and even common, to combine broadcast 
and point-to-point name management. The RFCs describe 
“Mixed mode,” and Microsoft later added “Hybrid mode.” 
These two modes differ only in the order in which the broad¬ 
cast and point-to-point mechanisms are applied. 



Data transport is handled either by the Datagram Distribution 
Service or the Session Service, depending upon the needs 
and design of the application. In the IP world, TCP provides 
connection-oriented sessions in which packets are acknow¬ 
ledged, put in order, and retransmitted if lost. This creates the 
illusion of a continuous, sequential data stream from one end 
to the other. In contrast, UDP datagrams are simply sent. UDP 
requires less overhead, but it is also considerably less reli¬ 
able than TCP. 

NetBIOS also provides connection-oriented (session) and 
connectionless (datagram) communications. Naturally, NBT 


Alphabet Soup 

The following is a list of acronyms relevant to the Microsoft Networking Protocols: 


CIFS 

Common Internet File System 

NBT 

NetBIOS over TCP/IP 

DMB 

Domain Master Browser 

NetBIOS 

Network Basic Input/Output System 

DNS 

Domain Naming Service 

SMB 

Server Message Block Protocol 

IPX/SPX 

Internetwork Packet Exchange/ 

SNA 

Systems Network Architecture 


Sequenced Packet Exchange 

TCP/IP 

Transmission Control Protocol/ 

LMB 

Local Master Browser 


Internet Protocol 

NBDD 

NetBIOS Datagram Distribution 

UDP 

User Datagram Protocol 


Server 

W2K 

Windows 2000 

NBNS 

NetBIOS Name Server 

WINS 

Windows Internet Name Service 
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uses TCP to carry NetBIOS sessions and UDP to carry Net¬ 
BIOS datagrams. These services run on 139/TCP and 138/ 
UDP, respectively. 



Sending a datagram to a unique name is fairly simple. The 
name is resolved to an IP address via the Name Service, and 
the NetBIOS message is tucked into a UDP packet that is 
sent to port 138. That’s it. 

Sending a multicast (group name) datagram is also fair¬ 
ly simple if broadcast mode name management is in use. 
In this case, group datagrams can be sent to the IP broad¬ 
cast address instead of a unicast address. All local nodes 
will see the packet, but only group members will actually 
open it. It’s not too tough. 

If the NBT virtual LAN crosses IP subnet boundaries, how¬ 
ever, sending NetBIOS datagrams to a group name gets a bit 
icky. Per the RFCs, the same system that is running the NBNS 
also runs a service called the NetBIOS Datagram Distribu¬ 
tion Server (NBDD); multicast datagrams are sent to the 
NBDD, which gets the list of IPs associated with the group 
name from the NBNS; the NBDD then forwards the data¬ 
gram individually to each group member. It’s sort of like send¬ 
ing a group e-mail to a mailing list server. You send one mes¬ 
sage, and the server takes care of distributing copies to all 
of the recipients. 

The problem with the datagram service is that Microsoft 
messed it up. They made a mistake when they implement¬ 
ed WINS. With the exception of one special case, WINS 
fails to keep track of IPs associated with a group name. In¬ 
stead, WINS stores only the generic broadcast address 255. 
255.255.255. Because of this, Microsoft never bothered to im¬ 
plement the NBDD. The upshot is that some group mem¬ 
bers will not receive group multicasts, which has implications 
for services that rely on group names. We will see an exam¬ 
ple of this later on when we examine the Browser Service. 

The sad truth is that SAMBA, in an effort to remain com¬ 
patible, followed Microsoft’s example. 


The NetBIOS 

.;«essiee.SerMitee ; 


Under NBT, NetBIOS sessions are created on top of TCP ses¬ 
sions. Here’s what happens when node FRED tries to 
establish a NetBIOS session with node ETHEL: 


> FRED uses the Name Service to find the IP address of node 
ETHEL. 


Ethal?” 

/ 


FredT 

\ 


Fred 


n 


Ethel 


> FRED establishes a TCP connection to TCP port 139 on 
node ETHEL. 



> FRED sends an NBT SESSION SERVICE REQUEST packet 
via the TCP connection. The request contains the NetBIOS 
name of the source node (FRED) and the NetBIOS name 
of the target node (ETHEL). 



> The SESSION SERVICE REQUEST can be rejected if 
ETHEL isn’t home (that is, the software that registered 
ETHEL is not actually listening or the name was never 
registered at all). If the request is accepted, the two sys¬ 
tems may send NetBIOS session packets via the TCP 
tunnel until the connection is closed. 





□ 


Ethel 


The Session Service is the simplest of the three NBT ser¬ 
vices. It does not need to worry about distributing messages 
to all owners of a group name since it is inherently a point- 
to-point service. It is, however, the transport for SMB file¬ 
sharing, so it is of particular interest to us. 




■' ; 





The purpose of NBT is to provide an emulated PC-Network 
LAN. It does not matter if the participating nodes are scat¬ 
tered across the Internet. If they share the same NetBIOS 
name space, they are on the same virtual wire. It is the Name 
Service that is responsible for creating and maintaining the 
name space, so the Name Service defines the virtual LAN. 

The NetBIOS API is the gateway to that virtual LAN, but 
non-Windows systems generally avoid using that interface. 
Instead, they typically craft the NBT packets and handle 
TCP and UDP transfers directly. This, unfortunately, can give 
the impression that SMB and its associated services are all 
IP-based, which really isn’t the case. Remember that the 
NetBIOS API has been implemented on top of lots of other 
protocols too. 
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Figure Three: Servers available on the network. 





Now that we have jumped through the flaming NET hoops, 
it’s time to juggle the SMB chainsaw. 

The first thing to note about Server Message Block is that 
SMB packets use Intel little-endian byte order, while NBT 
uses big-endian network byte order. No matter how you fid¬ 
dle with it, if you are going to implement SMB, you are go¬ 
ing to have to swap a few bytes. 

The Server Message Block is a record structure. The first 
field always contains the identifying characters ‘OxFF’ ‘S’ 
‘M’ ‘B’, just to make it absolutely clear what you are deal¬ 
ing with. The second field is the command. SMB messages 
are made up of a command, the data associated with the 
command, and the context in which the command is to ex¬ 
ecute. The context information allows SMB to keep track of 
multiple links multiplexed within a single NetBIOS session. 

Most of the SMB commands are derived directly from DOS 
I/O functions. They include basic stuff like OPEN, CLOSE, 
and DELETE, plus commands for handling print jobs and 
a few other oddities. Before these can be used, however, a cli¬ 
ent must gain access to a shared printer or directory (share). 
However, the SMB protocol has undergone a bit of evolu¬ 
tion since it was first introduced, and this has resulted in a 
number of “dialects.” To accommodate the various SMB di¬ 
alects, there is a NEGOTIATE SMB that lets nodes discuss 
and agree upon an SMB dialect to use. 

Documentation on SMB can be found on Microsoft’s FTP 
servers. Just dig around in ftp://ftp.microsoft.com/developr/ 
drg/cifs/ for a while if you are curious. Start with the older 
stuff and work your way forward. 


For Further Reading 

For additional information about SAMBA 
and Windows networking protocols, check 
out these two articles from previous issues: 

^ http://www.linux-mag.com/1999-'05/samba_01.html 
V http://www.linux-mag.com/1999-09/samba_01 .html 


Now it’s time to put a pretty face on all of this. On any Win¬ 
dows desktop, you will likely find an icon labeled “Network 
Neighborhood.” This is the front door to the GIFS (and SMB) 
world. Double-click the icon and you should see something 
resembling Figure Three. 

The icons in the window represent servers available on 
the network. (Your network, of course, will have different 
servers listed.) Double-click a server icon and you should 
see a list of the shares offered by that server. Figure Four 
contains such a list. 
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Figure Four: File shares available on the Scred server. 



The underlying system that makes this presentation possi¬ 
ble is called the “Browser Service.” This service collects and 
maintains the “Browse List,” and viewing the Browse List 
(e.g., via the Network Neighborhood) is called “Browsing.” 
It should be noted that Microsoft came up with these names 
before the invention of the Web Browser, so they cannot be 
blamed for any ensuing confusion. 

Browsing is organized in terms of IP subnets and Work¬ 
groups. A “Workgroup” is a set of NBT nodes on an IP sub¬ 
net that shares the same Workgroup name. In our examples, 
all of the nodes are members of the UBIQX workgroup. 

On each subnet, the Workgroup members hold an “elec¬ 
tion,” which involves sending group datagrams via the NBT 
Datagram Service. The election mechanism makes Florida 
recounts look easy, so we will save the description for an¬ 
other day. Eventually, a winner is declared and designated 
as the local “Master Browser” (LMB) for the Workgroup. If 
there are a lot of nodes in the Workgroup, additional local 
Browsers may be elected to serve as “Backup Browsers.” 

When a client wishes to see the Browse List, it asks one of 
the Browsers on the local LAN for a copy; this is what is dis¬ 
played when you double-click Network Neighborhood. 

As described earlier, the lack of a working NBDD in Mi¬ 
crosoft’s implementation of NBT limited browsing to IP sub¬ 
nets. Microsoft recognized the need to circulate Browse Lists 
outside of IP subnets, so they created yet another new serv- 
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Dual 1GHz CPU 
1U Rackserver 
for $1,995! 


[0mi 


Under 2K! 


$45/mo 


Instant Storage Solution! 

1U Rack height 
Fit up to 20TBs3 in a Rack 
From 1.1 cents per Megabyte 
RAID 0/1/5 & JBOD Support 
Easy-to-use NAS Manager sets 
up in less than 15 minutes 
Easily manage user and group 
access and security 
Auto detects and configures to 
your network 

Supports Windows, Unix, Linux 
& Mac clients 

Remotely manage over Internet 
with standard web browser 
Optional hot-swappable drives 
(Model 4000) 


NAS 4000 

«'2,795 

as low as ^94 per months 

■ 160GB^ Capacity, Max 492GB^ 

■ 4 X 406B !DE Hard Drive 

• 256MB Memory 

• RAID 0/1/5 Striping/Mirroring/Parity & JBOD 
- Optional Hot-Swap Drive Bays (Max 4 Drives) 

■ 2 X10/100 RJ45 Ethernet Ports (up to 4) 

• lURackmount (1.75”H/19’W23”D) 

248GB^ (4 X 62) ^ 

328GB^ (4 X 82) S 

410GB’ (5 X 82) i 

492GB’(6x 82) f 


NAS 3000 

M,495 

as low as ^69 per mott0 

■ 40GB’ Capacity. Max 328GB’ 
.2x20GB tDE Hard Drive 

• 128MB Memory 

■ RAID 0/1/5 Striping/Mirroring/Parity 

• JBOD Support 

■ 10/100 RJ45 Ethernet Port 

■ 1U Rackmount{1.75"H/19"W/23"D) 

80GB’ (2 X 40) 

120GB’ (2x60) 

248GB’ (4 X 62) 

328GB’ (4 X 82) 


Einux’s NAServ Storage 
Appliaaces offer “on the fly” 
storage that can he attached 
to your network and up in 5 
minutes or less. Plus, Einux’s 
NAServs offer the highest den¬ 
sity NAS storage appliances in 
the mdustry with up to 20.6 
Terabytes of storage capacity in 
a 19” rack. 


as low as ^175 per montif 

ModeM 4633-106 

• 4 X Intel Celeron 633 CPU 
■4x 128MB Memory 
■4x10GB IDE Hard Drive 

■ 4 X rntegrated 10/100 Fast Ethernet NIC 

• Red Hat Linux OS / Einux Browser Manager 


4 X Pent 650 14650-106 
4 X Pent 700 14700-106 
4 X Pent 750 14750*106 
4 X Pent 800 14800-106 
Up 0 to 4 X 256MB 
Upg to4 X 20GB HO 


Most cost'cffective Dual CPU 1IJ! 

: Dual Pentium ill CPUs, up to IGHz 
128MB Memory, up to 1.5GB 
30GB IDE Hard Drive 
Intel 10/100 Ethernet, up to 4 
1U Rack height (1.75”H), fit up to 
84 CPUs/42 Servers in a Rack 
Standard with Red Hat Linux 7, 
also supports Windows NT/2000 
Get Cobalt-like Server Appliance 
feature with optional Browser Man- 
ager'“ (see sidebar) for $399 more! 

Slandard Features include Dual CPU Ready Pentium (!i Motherboard, Intel 82559-based 10/100 Fast Ethernet Adapter; 3 
Optional Intel 10/100 Fast Ethernet Adapters (up to 4) @ $69/ea add 1. PS/2 Keyboard & Mouse/USB/Seriat/Parallel Ports. UJ 
Rackmount Aluminum Chassis (2 HD, 1 CD/FD/HD Drive Bays). 200 Watt ID PS, Emux Compact Cooling System. Red Hat ■ 
iinux 7 OS, Also supports Unix, Windows NT/2000 OS Dimensions; 1.75'‘H x 19' W x 23''0 


V-Raptor 1U Dual 1GHz 

Dual Intel Pentium III 1GHz 


$76/mo 


Dual Intel Pentium til 750 MHz 

*1,595 $59/mo T 

Dual Intel Pentium Hi 866 MHz 

*1,795 $68/mo 


NETWORK 


Custom configure your own server at www.einux.com 


SBTVlnOtlUIINIXt 
CALL 866.88.EINUX (883.4689) 

email: info(3einux.com 

Toll-Free: 1.866.883.4689Tel: 626.968.2686 Fax: 626.968.6565 
VARs/Resellers: Visit www.einux.com/reseller 

'Certain models only. Specs may vary. See specific model for details. ^Leasing figures are based on 36 months 
an are based on approved credit and may vary, ^storage capacities represent raw capacity and may vary accord¬ 
ing to configuration and partitioning. Not responsible for typo errors. Prices, configurations and availability sub¬ 
ject to change without notice. Call for details. All trademarks are acknowledged. Copyright 2001 Einux, Inc. 
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Lowest cost Dual Ready 1U Rackserver! 

1 to 2 Pentium III CPUs, up to 1GHz 
128MB RAM, Max 1.5GB 
20GB IDE Hard Drive 
Intel 10/100 Ethernet, up to 4 
Standard with Red Hat Linux 7, 
also supports Windows NT/2000 
Get Cobalt-like Server Appliance 
features with optional Browser 
Manager™ (see sidebar) for $399 
more! 


Phoenix 1U Dual CPU Ready 

Celeon 700 MHz Pentium ill 750MHz 

*995 $38/mo 


Pentium III 866 MHz 

*1,295 $49/mo 

Upgrade to 256MB $99 


*1,195 

Pentium Hi 1 GHz 

*1,495 $54/mo 

Upgrade to 40GB HD $99 


T-Bird1U AMD with RAID 

AMD Duron 750MHz AMD Duron 850MHz 

*1,195 $45/mo *1,295 $48/mo 

AMD Athlon 1 GHz AMD Athlon 1.2 GHz 

*1,495 $54/mo *1,695 $59/mo 

Upgrade to 256MB $99 Upgrade to 2 x 40GB HD $199 


standard Features include Dual CPU Ready Pentium III Motherboard, Intel 82559-based 10/100 Fast Ethernet Adapter, 3 Optional Intel 10/100 Fast 
Ethernet Adapters (up to 4) @ $69/ea add’l, PS/2 Keyboard & Mouse/USB/Serial/Parallel Ports. 1U Rackmount Aluminum Chassis (2 HD, 1 CD/FD/HD 
Drive Bays), 200 Watt 1U PS, Einux Compact Cooling System. Red Hat Linux 7 OS. Also supports Unix, Windows NT/2000 OS. Dimensions; 1.75”H 
x19"Wx23"D 


T-Rex 1U Dual CPU/SCSI 

Pentium HI 866 MHz Pentium HI 1GHz 

*2,695 $135/mo *2,995 $152/010 

Dual Pentium Hi 866 MHz 

*3,195 $135/010 

Upgrade to 256MB $99 


Dual Pentium HI 1GHz 

*3,495 $152/010 

Upgrade to 36GB SCSI HD $250 


Mega features at a mini price! 

1 to 2 Pentium HI CPUs, up to 1GHz 
256MB ECC RAM, Max 4GB 
18GB U160 SCSI hot-swap HD 
Up to 2 hot-swappable drive bays 
Built-in Adaptec Ultra 160 SCSI 
• Standard with Red Hat Linux 7, 
also supports Windows NT/2000 
Get Cobalt-like Server Appliance 
features with optional Browser 
Manager™ (see sidebar) for $399 
more! 

standard Features include Dual CPU Ready Pentium III Motherboard w/Adaptec Ultra 160 SCSI Controller, 2 x Intel 82559-based 10/100 Fast Ethernet 
Adapter, PS/2 Keyboard & Mouse/USB/Serial/Parallel Ports, 1U Rackmount Chassis (2 hot-swappable SCSI HD, 1 CD/FD/HD Drive Bays), 200 Watt 1U 
PS. Einux Compact Cooling System, Red Hat Linux 7 OS, Also supports Unix. Windows NT/2000 OS. Dimensions: 1 TS-H x 19"W x 23"D 

NAServ Network Attached Storage Filers 

Elnux's line of Network Attached Storage (NAS) filers let you instantly add storage to your network. Setting up in less than 
5 minutes usually, Einux's NAS storage filers let’s add storage to your network “on-the-tly" without disturbing any of your 
mission critical servers. Best of all, they start from 1.1 cents per megabyte giving you cost-effective storage. Test drive 
it yourself at littD://www.elnux.coin/nasdeiBo . 


First AMD 1 U & Fastest 1 U Available! 

Athlon/Duron CPUs, up to 1.2GHz 
128MB RAM, Max 1.5GB 
2 X 30GB IDE Hard Drive (RAID 0/1) 

Hardware IDE RAID on-board 
Intel 10/100 Ethernet, up to 4 
Standard with Red Hat Linux 7, 
also supports Windows NT/2000 
Get Cobalt-like Server Appliance 
features with optional Browser 
Manager™ for $399 more! 

standard Features Include AMD Duron/Athlon Motherboard with on-board Hardware RAID 0,1,0+1 IDE Controller, Intel 82559-based 10/100 Fast 
Ethernet Adapter, 3 Optional Intel 1 0/100 Fast Ethernet Adapters (up to 4) @ $69/ea add'l, PS/2 Keyboard & Mouse/USB/Serlal/Parailel Ports, tU 
Rackmount Aluminum Chassis (2 HD, 1 CD/FD/HD Drive Bays), 200 Watt 1U PS, Einux Compact Cooling System. Red Hat Linux 7 OS, Also supports 
^ nix, Windows NT/2000 OS. Dimensions: 1.75”H x 19”W x 23”D ___ . 

^ Einux Server Appliances 
^ f set up in 5 minutes or less! 

" . Einux’s optional Server Appliance Browser Manager™ System for Linux lets 
, s you set up a Linux-based Einux RackServer in less than 5 minutes using any 

' - standard Web browser and a TCP/IP Internet or Network connection. The 

Browser Manager™ also allows users to access and maintain Einux servers 
remotely from anywhere in the world. Best of all, the Browser Manager™ lowers the Total Cost of 
Management (TCM) because it makes it is so easy, almost anyone can set up an Einux Server, thus 
requiring little or no IT experience. Einux’s Browser Manager™ is optional on all Linux-based Einux 
RackServers and can be added tor $399 giving you Cobalt™-like Server Appliance functionality tor 
a fraction of the price! Test drive it yourself at http://www.einux.com/demQ . 




















er called the “Domain Master Browser” (DMB). The DMB re¬ 
gisters its name with the WINS server. All of the local Mas¬ 
ter Browsers look for this name and will send updates to 
the DMB, which then combines the lists and hands them 
back. The DMB is a work-around for the missing NBDD, 
essentially allowing browsing to cross subnet boundaries. 



NBT can be a pain in the neck, and old mistakes still haunt 
modern implementations. What is a multi-billion dollar cor¬ 
poration to do? 

As mentioned earlier, Microsoft introduced SMB without 


Open Source CIFS Projects 

SAMBA (www.samba.org) is the best-known and most popular Open Source implementation of SMB/ 
CIFS, but there are other projects aimed at leveraging these protocols. This is a partial listing: 


SMBFS for Linux 

Originated by Pal-Kristian Engstad, SMBFS allows a Linux 
system to mount SMB shares (shared directories). SMBFS is 
officially part of the Linux kernel. The project is now main¬ 
tained by Urban Widmark after changing hands several times. 

littp://www.samba.org, http://www.lceriiel.org 

SAMBA Appliance Branch 

SAMBA Appliance Branch is a slightly stripped-down version 
of SAMBA intended for Server Appliance devices (headless 
computers, rack-mounted in server rooms, requiring minimal 
management). Dave O’Neill maintains this code branch. 

http.V/www.samba.org 

libsmbclient 

Caldera asked Richard Sharpe of the SAMBA Team to 
produce an SMB client library for Linux/Unix. When 
finished, the library will make it easy to add CIFS client 
capabilities to applications such as KDE’s Konqueror. The 
library is being derived from SAMBA source. 

http://www,samba.org 

Fiiesys::SmbClient 

Alain Barbet has developed Perl modules that interface to 
SAMBA command-line utilities and to Richard Sharpe’s 
client library. 

iittp://searcli.cpa!i.org/searcli?iiiocie=doc&query=samha 

impiementing CIFS 

Yours Truly is desperately trying to document the workings of 
NBT, SMB, and CIFS to make it easier to implement. 

;;;ttp://www.iibtqx.org/clfs 


JCiFS 

jCIFS is a set of Java classes that implement SMB/CIFS pro¬ 
tocols and is aimed at the development of client applications. 
Michael Allen heads the coding effort. 

http://jclfs.samba.org 

SAMBA-TNG 

Luke Kenneth Casson Leighton, eager to explore the depths 
of Microsoft’s Remote Procedure Call (MS-RPC) system, 
created this SAMBA spin-off project with the help of several 
folks from the SAMBA-Technical mailing list. 

http://www.samba-tiig.org 

libsmb+ + 

libssmb++ is an SMB client library written in C++. Nicolas 
Brodu started the project, but is not able to pursue it further. 
This project is looking for a new owner. 

http://ilbsmb.sourceforge.net 

Sharity-Light 

Based on Linux SMBFS, Sharity-Light runs in user-space 
instead of as part of the kernel. Note that Sharity-Light is 
Open Source, but Sharity (no Light) is a commercial product. 
(Does that make it Sharity Dark?) Both are from a company 
called Objective Development. 

http://www.obclev.at/Proclucts/shlight.htm! 

SAMBA and SMBFS for Amiga 

It’s not dead yet! Olaf Barthel has ported both SAMBA 
and Sharity-Light to the Amiga platform. 

http://www.amigasamba.org 


There are probably more. The Open Source world Is a dynamic place with new stuff popping up 
all the time. Andrew Tridgell. originator of SAMBA, believes in competition within the communi¬ 
ty and has encouraged more than one of the above projects. Simply put, he believes the more 
people who know how different projects work, the better. 


in a speech at the Linuxworld Expo in New York, Tridgell said, “Let's just get rid of these horrible 
protocols." His hope — one shared by many SMB/CIFS developers — is that people will eventually 
understand how terrible CIFS is. and they will make it go away. 
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NBT in Windows 2000 and calls it CIFS. In CIFS, the 
SMB packets run native over TCP without the need for 
NetBIOS framing. Not only has NetBIOS been removed, 
but all of the supporting systems (like name resolution, 
browsing, and even authentication) have been replaced 
with standards-based services. WINS, for example, has 
been replaced by Dynamic DNS, and Kerberos is now 
used for authentication. At the core of all this is the 
Active Directory, which (like Novell’s NDS) is based on 
X.500. Unfortunately, Microsoft seems to have added 
their own spin to these services, and several sources are 
complaining about incompatibilities. 

SAMBA can work with Windows 2000 systems, as long 
as the latter are running in NBT-compatibility mode. Even 
so, a number of problems have been reported and, hope¬ 
fully, accommodated. SAMBA lives by adjusting itself to 
the quirks of each new Microsoft OS. 

The Linux community has only begun to dig into Win¬ 
dows 2000. It is an enormous animal that will take some 
time to dissect. Meanwhile, Microsoft is already work¬ 
ing on their next big products. We can only wait to see 
what changes will come with those. 


........ 

As we mentioned at the beginning of this article, SMB 
and CIFS are here to stay. For this reason, Linux must put 
itself on an equal playing field with Microsoft products 
if it is to be accepted as a mainstream operating system. 

Existing Linux client tools are command-line based, 
designed for use by folks who already know how this 
stuff works. Fortunately, efforts are underway to devel¬ 
op CIFS client libraries and other tools aimed at making 
CIFS easy to use from Linux. These tools will be incor¬ 
porated into popular desktop systems (such as KDE) so 
that Linux users can also browse CIFS shares from the 
desktop...just like Windows users can. 

While Linux is working to catch up, Windows has al¬ 
ready moved beyond the desktop and into palmtops, 
settops, and other markets. They have brought CIFS with 
them. Though it fits well in the back room with the big 
iron, SAMBA is too big for these environments. Linux 
needs tiny CIFS clients for the embedded market, simple 
servers for small-end network appliances, and graphical 
tools to help it on the desktop. 

In the Open Source Projects CIFS sidebar you will find 
information about some of the Open Source projects 
currently aiming to fully leverage CIFS for Linux and 
other operating systems. Get involved and get to know 
what these projects offer. These are the foundation of 
the future success of Linux in the Network Neighborhood. 

Chris Hertel is a member of the SAMBA Team and a 
founding member of the jCFFS Team. He can be reached at 
crh@samba.org. 
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Sun 

Microsystems ' 
is learning to live 
with Open Source 
whether they 



Robert McMillan 


It’s been an interesting couple of years for Sun Microsystems. In the fall 
of 1999 Java was slated to become a European Computer Manufac¬ 
turers Association (ECMA) standard, Solaris cost $700 a 
pop, and the company’s Chief Scientist, Bill Joy, was telling 
Linux Magazine that the GNU General Public License 
(GPL), “just doesn’t solve my business problems.” A year 
later Solaris was free, Java was not, and Sun had not only 
released the largest single whack of GPL code in history, it 
had also coughed up $1.3 billion to acquire a Linux company. 
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Conventional wisdom credits Sun with winning the Unix 
wars by virtue of its most significant and intangible asset — 
something financial analysts call “focus.” Throughout the 
last half of the 1990s, Sun Microsystems prided itself on hav¬ 
ing the simplest product line of the Unix vendors. While 
competitors like HP and IBM struggled with their multi-OS, 
multi-hardware strategies. Sun became the platform of 
choice for the new generation of Internet-enabled applica¬ 
tions, branding itself as the “dot in dot-com.” The strategy 
worked, in part, because inside that dot was a single micro¬ 
processor platform, the UltraSPARC, and a single operating 
system, Solaris. Focus. 

However, focus will only get you so far in the hi-tech in¬ 
dustry, and in September 2000 Sun surprised everyone by 
announcing plans to acquire server appliance manufactur¬ 
er Cobalt Systems. Suddenly the dot had some company. 
Cobalt’s product line featured two important technologies 
that were new to Sun — a new microprocessor from AMD 
and a new operating system called Linux. “It was, in a sense, 
an admission of failure on the part of their hardware de¬ 
sign team,” says IDC Program Vice President Dan Kusnet- 
zky. Sun’s low-end Netras, with their proprietary architec¬ 
ture, simply could not compete in the high-volume and rap¬ 
idly growing Web appliance space. 


A House Divided 


Even before it acquired Cobalt, Sun vacillated between be¬ 
ing dismissive (Sun CEO Scott McNealy once called Linux 
a “better NT than NT”) and friendly toward the Linux com¬ 
munity. In its new role as a Linux vendor. Sun has a long 
way to go in convincing Linux developers that it actually 
wants to help. “They’re not seen as contributing anything 
of value,” says SAMBA developer and VA Linux employee 
Jeremy Allison. He accuses Sun of holding strategic tech¬ 
nologies such as Java close to its chest. Not that Sun’s re¬ 
luctance to open-source the popular platform surprises him. 
“If you’re doing well, why would you bother?” he asks. 

The list of Sun’s sins against Linux is long. Sun is not seen 
as having given serious support to Linux on its UltraSPARC 
hardware; its restrictive licensing policy delayed the devel¬ 
opment of a Java virtual machine for Linux, and it has 
snubbed key open source developers. In late 1999, the hack¬ 
ers working on the Blackdown project were up in arms 
when Sun released a Java virtual machine for Linux that 
included their code but failed to give them credit for their 
work. Nearly a year later, noted device driver author Donald 
Becker saw red when Sun released a cross-compiler for So¬ 
laris that included his code and was, in Becker’s opinion, 
in violation of the GPL. Add to this McNealy’s occasional 



Source 


I Project: 
f Description: 

URL: 


Netbeans 

D&scription: Java IDE for Solaris, Linux, and 
Windows 

URL: http://Netbeans.org 

Project: 


Open Office 

‘f Description: GPLed suite of office productivity 

^ applications 

URL: http://openoffice.org 

Project: GNOME 

D^cription: Sun plans to replace Solaris’s 

Common Desktop Environment (ODE) 
with GNOME and is actively working 
on the open source project 

URL: http://gnome.org 


Sun is getting its feet wet in the open source 
ocean. These are the projects it’s working on. 


A- 


Tomcat 

Reference implementation of Java 
Server Pages for Apache 

http://Jakarta.apache.org/tomcat/ 

index.html 


Project: 


Project: 

Description: 

URL: 


Project: 
^^^cription: 

URL: 


Project: 

Description: 

URL: 


NFS 

Sun’s Unix-standard Network 
Filesystem 

http://www.citi.umich.edu/proJects/ 

nfsv4 

Jxta 

Sun’s forthcoming peer-to-peer 
platform 

http://Jxta.org 

Crimson 

A Java XML parser 

http://xml.apache.org/crimson/ 

index.html 

Brazil 

A framework for connecting a variety 
of devices on the Web 

http://www.sun.com/research/brazii 


Project: 
m Description: 

I URL: 

W-'i 

I Project: XilSn 

Description: Internationalization enhancements for 
the X Window System 

URL: http://ftp.x.org/contrib/il8n 
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inflammatory remarks, and the Linux community’s nag¬ 
ging suspicion that Sun sees Linux as more of a threat than 
it lets on, and you get the basis of a stormy relationship. 

But there is no doubt that open source has Sun’s atten¬ 
tion. Pat Sueltz, the Executive Vice President of Sun’s Soft¬ 
ware Systems Group and the person who is ultimately re¬ 
sponsible for both Solaris and Java, says that Sun clearly 
has a lot to learn from the open source community. “I can 
see that it actually changes the way we’re developing code,” 
she says. “There’s an iterative process that comes out of the 
open source community, and we’re exploring that.” (See 
the Q&A with Pat Sueltz sidebar, pg. 42.) 

And though Sun has spent years casting itself as a white 
knight in a battle with proprietary software’s most vilified 
dark lord, Microsoft, there is a clear financial incentive for 
the company to get on the open source train. In a recent 
report entitled “Open Source Infrastructure: A Manifesto 
for the Coming ‘Big Bang,”’ Deutsche Banc Alex Brown an¬ 
alyst Phil Rueppel cited Sun Microsystems as his top pick 
for investors looking to buy stock in an established com¬ 
pany that stood to profit from the open source space. “De¬ 
spite the company’s appearance as being hostile to open 
source,” wrote Rueppel, “we believe that Sun understands 
both the advantages of an open source development model... 

and the rich value proposition of a ‘single 
stack’ IT solution.” 



I i/i/as young and dumb... 
It was about 14 months of 
my life — meeting with people, 
talking with people. 

— James Duncan Davidson, Sun Microsys¬ 
tems, on getting the Tomcat code released. 


Rueppel, now a principal with TA Associates in Boston, 
says that while Sun stands to gain much from open source, it 
still needs to figure out how to better embrace the Linux and 
open source communities. “On one hand,” he observes, “they 


don’t believe that Linux will work at the high end, so they 
dismiss it. But on the other hand, they support it because it 
undermines Microsoft. They’re speaking out of both sides of 
their mouths, and I think that’s going to have to be clarified.” 


Letting Tomcat Out of the Bag 


Work on what would eventually become the first signifi¬ 
cant piece of open source code written and maintained by 
Sun engineers began in 1998, when a developer inside of 
Sun’s Java group named James Duncan Davidson began a 
rewrite of Sun’s Java Servlet Reference Implementation. At 
the time. Sun was beginning to get pressure from its In¬ 
ternet Service Provider (ISP) customers who were looking 
for an alternative to Microsoft’s Active Server Pages (ASP) 
for displaying dynamic pages on the Web. Sun had a Java- 
based alternative to ASP called Java Server Pages (JSP). 
The problem was that the Web server code needed to run 
JSPs was not as mature or as widely deployed as it needed 
to be and the Apache project was working on its own, 
divergent implementation of a JSP server. Davidson, who 
had worked with open source tools before coming to Sun, 
knew that an open source implementation that was sup¬ 
ported by the Apache group would go a long way to solv¬ 
ing both of Sun’s problems. So, he began rewriting Sun’s 
Java Web server with a view to open-sourcing the code. 

There were two problems. No one in management had 
signed off on the idea, and Sun had never released open 
source code on this scale. “I was young and dumb,” remem¬ 
bers Davidson. “We were really coming out of left field.” 

Over the next year, Davidson continued to work on the 
code, but more and more of his time was spent with meet¬ 
ings: QA, standards, and conformance teams, lawyers, and 
management. Everyone had to be brought on board; that 
required a lot of open source advocacy. “It was about 14 
months of my life — meeting with people, talking with peo¬ 
ple,” he says. 

In the end, Davidson says, it was pressure from IBM that 


Sun releases SCSL, 
its not-quite-open-source 
license for Java. 


January iSSS 


Sun announces plans to 
release Solaris under SCSL. 


October fSSS 


Sun creates an open source license — 
the Sun Industry Standards Source License; 
an implementation of NFS is the first code 
released under the new license. 


February 2000 


June iSSS 

Tomcat code released 
to the Apache Software 
Foundation. 


December 1393 

A press release announcing the release of the latest 
Java platform for Linux credits Inprise, but not the open 
source Blackdown project, for its work on the port. 
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helped get the go-ahead for the project. The help came from 
an IBM product manager named James Barry, who had 
been influential in getting IBM involved in the Apache pro¬ 
ject. Barry was convinced that Davidson’s code — Tomcat 
— would be best off as part of Apache, so he started mak¬ 
ing some phone calls to Sun. Initially, Sun’s management 
had visions of releasing Tomcat under Sun’s Community 
Source License, but in June of 1999 — after a meeting be¬ 
tween Barry and the Java group’s General Manager Jon 
Kannegaard — Tomcat was turned over to the Apache Soft¬ 
ware Foundation. For the first time ever. Sun was actively 
supporting an open source project based on their own code. 


Blame Microsoft 


Sun and Microsoft have never had good relations. In the 
1990s Sun saw its bread-and-butter workstation business 
dissolve in a sea of lower-cost NT desktops, but its most 
public disagreements with Redmond have been over Java. 
There has been acrimony, mud-slinging, and massive PR 
maneuvering since March 1996, when Microsoft signed its 
licensing deal with Sun, until early this year, when the two 
companies finally reached an out of court settlement, and 
Microsoft terminated the agreement. 

Though Sun has opened up the way that developers can 
define the Java APIs, it has remained intractable in its de¬ 
sire to control how the Java virtual machine is implement¬ 
ed. Microsoft says this control has curbed innovation. Sun 
claims that Microsoft’s only goal has been to break Java 
compatibility. To those who were there, it is not surprising 
that, after five years under the withering effects of direct 
competition with Microsoft, Sun would be reluctant to open- 
source Java. “Microsoft was vicious, aggressive, and really 
detestable in the way they handled themselves with respect 
to Java,” says Rick Ross, President of JavaLobby, a devel¬ 
oper advocacy group that was closely involved in the Sun- 
Microsoft Java wars. “I think Microsoft really intentionally 
hurt Java — and hurt it badly,” he adds. 



On one hand, Sun doesn’t be- 
lieue that Linux will work at 
the high end, so they dismiss 
it. But on the other hand, they 
support it because it undermines 
Microsoft, They’re speaking out of both sides 
of their mouths, and I think that’s going to 
have to be clarified, 

— Phil Rueppel, TA Associates 


“The people who took the little seed of Java and grew it 
to where it is, they just about killed themselves in the pro¬ 
cess,” says James Davidson’s current boss, Danese Cooper, 
who runs Sun’s Community Development Program Office. 
But these days, the old guard is leaving the fold. Alan 
Baratz — who was in charge of Sun’s Java division during 
the heyday of the Microsoft conflict — left in 1999 to work 
for a New York financial firm (he subsequently returned to 
Silicon Valley to become CEO of a startup named Zaplet). 
Jon Kannegaard — Baratz’s interim successor — recently 
moved to the greener pastures of SunLabs, along with Java’s 
inventor, James Gosling, and former VP of Java Technology 
and Architecture, Jim Mitchell. “There has been a big shift 
in personnel,” says Cooper. 

As the Java warriors leave, new blood, like Tomcat’s David¬ 
son, is coming to Sun with new ideas about the role of 
open source. Pat Sueltz has a pretty good idea of what it 
means to be a partner in Sun’s Java community. She came 
to Sun after spearheading IBM’s Java initiative. Another 
influential outsider is Marco Boerries, who came to Sun as 
part of its StarDivision acquisition in 1999. He’s the guy 
who convinced Sun’s President, Ed Zander, to GPL the Star- 
Office code. 

Finally, there is Roman Stanek. After his company. Net- 
beans, was acquired by Sun in 1999, Stanek successfully 
lobbied to have his core product released under a Mozilla- 
like open source license. That project, Netbeans.org, became 
Sun’s next foray into the world of open source. 


Netbeans project 
launched. 

June 2000 


Sun uses Donald Becker’s GPLed code in a Solaris 
cross-compiler, despite Becker’s objections; the 
software is later withdrawn from Sun’s Web site. 


August 2000 


August 2000 

Sun announces plans to replace CDE with 
GNOME and Joins the GNOME Foundation. 


OpenOffice launched. 

October 2000 


February 2001 

Sun takes on Microsoft.net, announcing 
plans to release its Jxta peeiM:o-peer i 
software under an open source license, j 
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Magic Beans? 



Sun has long understood that one of Microsoft’s greatest 
strengths is the popularity of its Visual Basic development 
tools, and since the early days of Java, it has striven to cre¬ 
ate a market-standard development tool for Java. Rick Ross 
says that while developers have looked to Sun to produce the 
Java equivalent of Visual Basic, Sun has failed to produce 
a contender. “As much as people lambaste it. Visual Basic 
has been an amazing product at the market level — selling 
millions of units and used by millions of developers on a 
daily basis. It’s something that can be extended in a thou¬ 
sand different directions by a thousand different modular 
reusable component products,” says Ross. “1 don’t think any 
Java development environment I’m aware of 
approaches its really amazing ease.” 



‘‘While IBM’s engineers are 
part of the community, Sun 
engineers are not,” 

— Jeremy Allison, SAMBA developer 


Sun spent five years working on an integrated develop¬ 
ment environment (IDE) called Java Workshop, but the pro¬ 
duct never caught on. Having failed to create a VB-like hit 
with Java Workshop, Sun began to shop around, hoping to 
build a popular product out of proven technologies. Even¬ 
tually, Sun spent $700 million acquiring two tool companies 

— Forte and Netbeans. The company then proceeded to 
consolidate the Workshop, Netbeans, and Forte technol¬ 
ogies into one product line. “By the time we were capable 
of executing on a plan, we were like, ‘Oh my gosh, we’re 
really late to the party,”’ remembers Stanz Kleinen, General 
Manager of Sun’s Forte development tools group. This sense 
of urgency made Sun more receptive to Stanek’s plan to 
open-source his company’s core product. “ 1 think it helped 
us be more bold and do some things that maybe we would 
not have done had we had our act together a couple of 
years sooner,” says Kleinen. 

The Netbeans project has been growing steadily since Sun 

— with the help of open source consulting firm Collab.net 
(which just happens to be the current employer of Tomcat 
advocate and ex-lBMer James Barry) — released the Net¬ 
beans code in June 2000, fostering a small, but thriving, 
community. According to Sun, there are fewer than 10 de¬ 
velopers — outside of Sun employees — who have CVS 
commit access (the right to change the Netbeans source 
code), and the project’s main discussion list pulls a respec¬ 
table 40 or so posts a day. Sun also claims to have about 40 
partners who are building Java components on top of Net¬ 
beans — a decent start for a project that has yet to celebrate 



with Pat Sueltz 


If anyone iahII open source Jaua, it’s Pat Sueltz. 
After earning a high profile in the Java com¬ 
munity as the executive behind IBM’s Java ef¬ 
forts, Sueltz came to Sun to head up its soft¬ 
ware division. She is responsible for Java, So¬ 
laris, and all of Sun’s open source efforts. 

Linux Magazine: Do you think there’s space for 
Solaris in the Cobalt product line? 

Pat Sueltz: I have to tell you right now that I’m not 
looking at Solaris on the Cobalt line because I look at 
Solaris as the uninterruptible power supply of the 
Internet. It’s customizable and it’s rocket science that 
we’ve got out there. We’ve made it much simpler for 
sysadmins to work with, but it’s very different from 
Cobalt. That’s really picking up the gateway, the edge 
of the network. If people do want to work on the edge, 
and they want to program to it, then we’ve got the 
Netra, and that has Solaris in it. 

LM: Are you saying that you don’t really see Solaris 
competing with Linux in the foreseeable future? 

PS: What I see is that Linux has enlarged the com¬ 
munity of Unix-sawy, Solaris-ready professionals. I 
have three points I would make about Linux. First, we 
work very closely with the Linux community as a chan¬ 
nel. Red Hat applications port to Solaris readily — 
there is one-to-one compatibility. We work with J2SE 
[Java? Standard Edition] on the Linux environment, 
so we engage the Linux community as a channel in 
this way. We have recently come out with J2EE [Java? 
Enterprise Edition] for the Linux environment. 

The second point is that Linux is not only a chan¬ 
nel, it’s a community. We’re not only working with the 
major distributors, we’ve got tools for Linux and we’re 
going to continue to put StarOffice out on all the 
major systems. So you’ve got Linux as a channel and 
Linux as a community, and we participate in both of 
those. 

Finally, there’s Linux as an Intel architecture. We’re 
a SPARC-archItected company, and I don’t play in that 
game. But the fact is — as you’ve seen with our ap- 
: pliance strategy — when it doesn’t matter what’s in¬ 
side, I don’t care. I don’t really care what’s inside the 
: phones either. 
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LM: Do you think that Solaris will ever be released j 
as an open source operating system? 

PS: I’m not ready to speculate on that yet. I’ll just I 
tell you that we continue to contribute mightily to the 
community. We Just made a great contribution with 
NFS and we’ll continue to do those things. 

LM: Do you think Java will ever be released under | 
an open source license? L 

PS; Let me tell you the strategy that I’ve been work- | 
ing on with Java. It’s always been about compatibili¬ 
ty. Because it has been made the holy grail of inter¬ 
operability of applications, there were folks who want¬ 
ed to co-opt it. Because of that, the path that I’ve 
been on is to make sure that I open up the process ^ 
for changes. So one of the strategies that I came to | 
Sun with was to fix the Java community process. And | 
we’ve done that. We’ve now got two bodies of 16 
stakeholders; it isn’t the entire open community, but 
it’s folks who have licensed Java and includes folks 
like Nokia, Fujitsu, IBM, BEA, and Apple. We’ve got J 
the key players that are working on Java as the exec- r 
utive committee to make the decisions about what f 
the future of Java is. And that process is one vote per ^ 
company. Sun chairs it, but to be sure, the votes 
don’t all go Sun’s way. ! 

LM: So you’re saying you think Java is basically t 
open enough as it is right now? I 

PS: You know, I never say never; I will tell you that I 
think we’ve opened up the process and that I’ll con- F 
tinue to look and see what happens in terms of the | 

open community. This is all an evolution and it’s all f 

about ensuring that we stay in touch with the devel- f 
oper community. Right now, I think I’ve got the pro- I 

cess open, and certainly my constituents of the 300 ! 

licensees are happy with it, and we’re going to keep 'I 
watching and learning from it. 

LM: What do you think are the greatest risks pre¬ 
sented by open source? 

PS: I don’t think we know yet. I think we have to lis- ] 
ten and then think about consequences. Remember, 

I live in a commercial world where millions of people 
have invested in Sun Microsystems. So I just want to 
make sure that I make good decisions for my share¬ 
holders at the same time that I’m making great deci¬ 


sions for customers and developers. I don’t really | 
see a risk. I just think that it’s a learning process. f 



its first birthday, but a far cry from the kind of popularity 
Microsoft has built around Visual Basic. 

The fact that Netbeans has earned far less attention than 
Sun’s best-known open source project, OpenOffice, was in¬ 
tentional, says Sun’s Danese Cooper, so as not to turn off the 
developer community with an avalanche of marketing hype. 
‘The engineers really wanted it to have an engineering 
focus. They didn’t want a lot of hype,” she says. 


Desktop Duty 


With OpenOffice, on the other hand. Sun wanted to get the 
attention of end users, not just developers, with Sun’s PR 
machine in full gear (news of the project was widely report¬ 
ed as a possible Microsoft-killing move on the part of Sun). 
It was followed, a month later, by news that Sun planned 
to drop Solaris’s standard desktop software, CDE (the Com¬ 
mon Desktop Environment), in favor of an open-source 
alternative, GNOME — an announcement that was, again 
(surprise, surprise) played up as a possible threat to Mi¬ 
crosoft. (For more on GNOME and OpenOffice, see Linux 
Magazine’s December story, “The Meaning of GNOME,” lo¬ 
cated on the Web at http://www.linux-mag.eom/2000-12/ 
gnome_01.html.) 

The OpenOffice project has yet to gain serious developer 
momentum, but in December 2000 — two months after its 
launch — Sun passed an important milestone by giving the 
first non-Sun developer the right to modify the OpenOffice 
source code. And Sun’s GNOME efforts appear to be on the 
right track. “It’s certainly going a lot better than a lot of other 
corporate involvement that we’ve seen,” says Havoc Pen¬ 
nington, the chair of the GNOME Foundation Board. “We’re 
getting people involved in the discussions; 
we’re getting patches back.” 


I can see that [open source! 
actually changes the way we 
are developing code. There’s an 
iterative process that comes out 
of the open source community, and 
we’re exploring that.” 

— Pat Sueltz, Sun Microsystems 



Still, it’s not clear how strategically important these desk¬ 
top-focused initiatives are to either Sun or Linux. Sun itself 
has a hard time articulating how a company whose fastest 
growth is now occurring in data centers is going to profit 
from releasing a free, GPLed office suite. Bill Roth, the Group 
Product Manager for OpenOffice, says that the project is, in 
part, an attempt to win the hearts and minds of open source 
developers. “We had to make a kind of Nixon-going-to-China 
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NSH Deploy 



NSH Deploy Features/Benefits: 

- Massively parallel pushing for minimal deployment time 

- Job scheduling for automated deployment 

- Pull files as well as push files for extended functionality 

- ACLs and encryption for maximum security 

- Independent verification for anytime consistency checking 

NSH Utilities 


Bifoot@t'eclhat62:/root Ilk® 


re<Ihab62 $ /bin/nsh 
re<Ihab62 $ seb -o vi 

re<lhab62 $ Is -1 //rGd0hiab62/ebc/passwd //redhabeo/Gbc/passwd 

-rw-r--r-- 1 roob roob 629 Nov 26 17;14 //rGdhab60/Gbc/passwd 

-rw-r--r-- 1 roob roob 592 Fob 24 14:01 //rGdhab62/Gbc/passwd 

rG<Ihab62 $ cd //solarisS/Gbc/mail 

soiarls8 $ op aiiasGS //aix/bmp/aliasGs.nGW 

solarise $ diff aliasGs //aix/bmp/aiiasGs.nGw 

solarise $ hgxgo rsdliab60 /Gbo/rc.d/rcl.d/seOsGndmail rssbarb 

Shubbing down SGndmail; ( OtC 1 

Sbarbing SGndmail: I OK 1 

solarise $ runcmd -h rGdliab62 rG<lhab60 -g df -k / 

i==> rGdhab62 <== 

FilGsysbGm Ik-blocks UsGd AvailablG Usg% MounbGd on 

/dGv/hda6 1992300 647088 1244008 34% / 

==> rG<Ihab60 <== 

; FilGsysbGm Ik-blocks USGd AvailablG Usg% MounbGd on 

/dGv/hda2 991000 446600 493194 48%/ 

solarise $ cd //frGsbsd32 
frG6bsd32 $ ps -aux | grop incbd 

roob 149 0.0 0.9 900 580 ?? Is Sab03PM 0:00.06 insbd 

frGGb6d32 $ kill -s 1 149 
frGGbsd32 $ nGXGC nbdGV rGboob| 

I 

7 


The Network Shell (NSH) Utilities are a UNIX shell 
environment with distributed capabilities. In other words, 
a distributed scripting language giving you secure access 
to multiple UNIX, Linux, and/or Windows servers at once 
from a command line, or (shell) script, without the need to 
ftp, telnet, or rlogin to each server one at a time. 

- Manipulate files, directories, and processes 

- Execute remote commands and scripts 

- Encryption, compression, and ACLs. 
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In pitching the open source philosophy to their 
peers at Sun Microsystems, the Netbeans p 
team came up against four commonly held ' 
myths about open source: 

Myth 1 Anybody can change code on your project’s 
CVS at anytime. 

Myth 2 Open source means free labor. 

Myth 3 Open-source it and they will code. “This Isn’t ; ; 
the Chia Pet of software,” says Sun’s 
Danese Cooper. 


Myth 4 The only smart engineers are the ones 
employed by your company. 


a 


effort to prove to people that we were serious about this.” 

SAMBA’S Jeremy Allison says that if Sun really wants 
to convince the open source community that it is seri¬ 
ous, it should take a page from IBM’s playbook. IBM, 
says Allison, has developers on a wide variety of mail¬ 
ing lists who are actively contributing patches to all parts 
of the open source community. Allison maintains that 
Sun engineers tend to focus on Sun-sponsored projects 
and, with the exception of GNOME, tend to have a pret¬ 
ty low profile. “IBM’s engineers are part of the commu¬ 
nity,” he says. “Sun engineers are not.” 

Respected developer Don Becker, who is still unhap¬ 
py about the way Sun used his GPLed driver code in a 
Solaris cross-compiler, agrees. In an e-mail interview, he 
wrote, “There are parts of Sun that seem reasonable, but 
most of Sun is aggressively anti-open-source,” adding, 
“I’m very impressed with how IBM has understood Open 
Source and the GPL as it relates to doing business and 
working with the community. I’m sending this letter 
from the Extreme Linux Developers Forum. IBM people 
gave a talk. No Sun people are here.” 

All this will change if Danese Cooper gets her way. 
She says that Sun has not yet reached the mid-way point 
in its evolution into an open-source-aware company, but 
successes like Netbeans and Tomcat are going a long 
way to assuage the trepidation within Sun. In addition, 
she is spending much of her time traveling around to 
Sun’s different divisions, explaining the open source phil¬ 
osophy and helping Sun’s product people to see where 
it might fit into their future. One of the few people work¬ 
ing for Sun who has publicly stated her support for the 
open-sourcing of Java, Cooper is optimistic that Sun will 
make the transition into the open source community. “1 
think that Sun is culturally ready for this change to hap¬ 
pen,” she says. 


Robert McMillan is editor at large with Linux Magazine. 
He can be reached at bob@linux-mag.com. 
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Mat makes a successfpilien source compiki 


If there's one corporation 
worth examining to answer this question, it's Red Hat. Since awakening the 
financial community to the open source phenomenon with its remarkable 
IPO in August of 1999, Red Hat has steadily been writing the book on how 
to build a Linux business. Linux Magazine's/Kdam Goodman, Robert McMillan, 
and Chris Somerville recently caught up with Red Hat CEO Matthew Szulik to 
discuss the lessons learned during his company's first year and a half as a 
public company. Szulik, a mild-mannered Bostonian who had recently shaved 
his head for a charity, has seen a fair bit in his first year at the helm: A dozen 
acquisitions, executive flight (CFO and CTO), and a stock that soared to $300/ 
share and then plummeted to 1/30th of that value. But in the end, he says, 
it's the future, not the money, that motivates him each day. 
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Linux Magazine: The world has 
sobered up since we spoke with [Red 
Hat Chairman] Bob Young last year. 
How has it felt to have your stock drop 
from such a height? 


When our stock hit 
$300 and there was 
wild enthusiasm, I said, 
'This is one of the worst 
days of my career/ 


Matthew Szulik: When our stock hit 
$300 and there was wild enthusiasm, 
1 remember having this discussion 
with Bob. I said, “This is one of the 
worst days of my career.” He asked, 
“Why?!! ” He was having a good time 
and was caught up in all of this. 

1 had watched a group of incredibly 
bright young people work their butts 
off, deal with just incredible changes 
and challenges, and 1 thought that a 
wild stock price — an $18 billion mar¬ 
ket cap on the strength of a boxed 
product — was going to take away 
from all of the good work that had 
been accomplished, and most impor¬ 
tantly, from the bigger challenges that 
lay ahead of us. 

All the Microsoft hoopla made good 
theater, but Microsoft is a company 
with $26 billion in cash in the bank. 
They’re an incredible American suc¬ 
cess story, and with all due...actually 
with a lack of respect for their practi¬ 
ces, 1 knew that the hard work was be¬ 
fore us. We had yet to be challenged. 

With all of that in mind, I didn’t see 
the wild enthusiasm. 1 wasn’t one of 
the cheerleaders. 1 was saying, we’ve 
got to get the follow-on offering out; 
let’s move. We’ve got to get the Cyg- 
nus acquisition done; let’s go. We’ve 
just got to keep scaling and keep dri¬ 


ving the company to perform as rap¬ 
idly as possible. 

LM: So if you could do it again, would 
you go public when you did? 

MS: 1 wouldn’t change a thing. 

LM: But you thought it was a bad 
thing when the stock hit 300? 

MS: Because of what’s happening 
now. Today we’re sitting here and the 
stock’s got a $1.3 billion market cap 
and there are probably people writing 
stories that 1 should be slicing my 
wrists. When you take a look at the 
complete picture of who we’re choos¬ 
ing to compete against, when you 
look at our financial position — we’ve 
improved the gross margins of the 
business from 46 percent 16 months 
ago to 60 percent in this last quarter 
— we’ve got $320 million in the bank; 
we’re on the verge of being profitable. 
We’ve got great relationships with IBM 
and Compaq and Dell and others. 

Why do people want to make me 
feel lousy? We have introduced 16 
new lines of revenue into our compa¬ 
ny. We’ve been able to hire great peo¬ 
ple. And I think one of the most impor¬ 
tant elements is that we have been 
true to our commitment to the open 
source model. The questions used to 
be, “When are they going to go to the 
dark side? When are they going to 
start adding proprietary layers? When 
are they going to flip the model and be¬ 
come a proprietary company?” Heck, 
we cancelled revenue streams that had 
a proprietary component in them so 
we could continue to keep this vision 
and keep this momentum alive. 

LM: What revenue streams did you 
cancel? 

MS: When we bought Cygnus, they 
had a 75-person development effort 
working on a proprietary IDE (inte¬ 
grated development environment) for 
the semiconductor simulation market. 
It was called the Churchill project. We 
cancelled it. 


LM: How did your employees react? 

MS: It made a lot of people very angry. 
People had devoted a year of their lives 
to developing this technology. 

LM: What led you to acquire Cygnus? 

MS: Let me describe some of the con¬ 
ventional thinking we were hearing at 
the time. We were hearing from enter¬ 
prise customers that in order to be 
competitive with Microsoft and oth¬ 
ers, we needed to have a platform with 
a consistent API [Application Program 
Interface] from server to handheld de¬ 
vice. If you’re really going to be em¬ 
braced strategically by the Global 2,000 
— especially as wireless and other 
technologies loom as part of their five- 
year IT plans — you need to have an 
answer to that, and we didn’t at the 
time. So that was issue number one. 

Second of all, there was a very pop¬ 
ular question a year ago. “What about 
the desktop? Why don’t you go out 
and buy Corel?” But Microsoft had 92 
percent of that category. We didn’t 
think it was a very forward-looking 
category. A lot of smarter people than 
us fought that war and lost. As a Bos¬ 
tonian, I had watched Lotus’s franchise 
crumble under the weight of trying to 
compete with Microsoft. We made a 
strategic decision at that time to move 
forward and not compete on the exist¬ 
ing playing field. We would get into 
the handheld and device marketplace. 
We thought that that was where the 
next frontier would be. And all of this 
gets tied together with the Red Hat Net¬ 
work. That is the cornerstone of the 
whole company. 

LM: How is what you’re doing with 
Cygnus different from what you orig¬ 
inally expected? 

MS: The conventional rule of thumb 
is that 65 to 70 percent of acquisitions 
fail. Cygnus was 11 years old when we 
acquired them and had gone through 
multiple changes over its history. What 
we saw was great engineering talent; 
the core engineering leadership of the 
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company had a strong commitment to 
open source. Most importantly, they 
had great customer references. They 
knew how to build sophisticated pro¬ 
jects and get them delivered on time 
and on plan. That was a discipline that 
we thought was important for our 
company. When we acquired them, 
we were just completing the follow- 
on offering and we were also a very 
young company. So 1 think we’ve 
learned a lot about how to integrate 
companies. From that perspective it 
was a great learning experience for us. 
And we’ve learned to do better with 
our subsequent acquisitions. 

LM; How has it played out then? Are 
there any customers that you can talk 
about that have been able to take ad¬ 
vantage of your competencies in this 
wide range of offerings? 

MS: Oh, definitely. 1 don’t think the 
people that we’ve partnered with 
would see us as a complete solution 
provider if we didn’t have an answer 
to the portable device story. If we 
didn’t have that, we would have giv¬ 
en them a reason to move away from 
the Red Hat relationship, and we 
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continuous innovation, continuous up¬ 
dates, and do that on a monthly sub¬ 
scription basis.” 

If you look at that, you’ll see that 
we chose to start a subscription rela¬ 
tionship at the expense of perhaps 
some valuation upside. If you look at 
our balance sheet, you’ll see a line of 
deferred revenue there of $12-13 mil¬ 
lion, which unfortunately we don’t 
get a whole lot of credit for from [Wall 
Street]. This was the beginning of our 
strategy for getting into the subscrip¬ 
tion model — to build and monetize 
a relationship with the millions of peo¬ 
ple who have touched the Red Hat 
brand. The Red Hat brand could be 
expanded to include the distribution 
of not just our technologies, but other 
technologies as well. 

LM: Bob Young has said that he sees 
Red Hat as the Wal-Mart of technolo¬ 
gies — that you can buy all these open 
source technologies through Red Hat. 

MS: He never said that to me, but I’m 
glad he thinks that way. 

LM: He has a metaphor for almost 
every occasion. 
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that will continue to be the case. 
You’ll throw it away, and new func¬ 
tionality will be added. But when we 
have spoken to executives at Nokia, 
Ericsson, Sony, and others, their cost 
of customer acquisition is so high that 
the more they can enable that device 
to stay in your hand and use the net¬ 
work to upgrade that, the more they’re 
able to continue and keep that brand 
relationship with you. It’s not the man¬ 
ufacturing cost that they’re worried 
about; it’s the cost of switching. 

In speaking to Ericsson about the 
Web Pad, we would like very much to 
enable the enhancement of that device, 
or the extension of new services or 
new value-add to it. We would want 
to be involved whether it’s through 
Ericsson.com, which is being back- 
ended by Red Hat, or directly through 
Redhat.com, where we can introduce 
new services and new value-adds and 
participate in the revenue stream on 
the incremental dollar amount that Er¬ 
icsson will be charging their customers. 


LM: Why do you think the subscrip¬ 
tion model is the right one for Red Hat? 

MS: 1 think two things make subscrip¬ 
tion work for Red Hat. One is our rev¬ 
enue-recognition practice, because for 
a company that’s been basing their 


business model and their financial re¬ 
porting on the sale of software licenses 

— to go back and restate that as a sub¬ 
scription, especially as a public com¬ 
pany, is not easy. 

The second is that one of the great 
benefits of open source is the contin¬ 
uous improvement of the product. So 
when a customer buys a subscription 

— if the release is every two to three 
years like Solaris, or four years like Mi¬ 
crosoft — where’s the value? In the 
case of Red Hat, we produce two to 
three versions every 14 months. 

LM: So how fast is the Red Hat Net¬ 
work growing? Can you tell us how 
many subscribers you have? 

MS: 1 believe when 1 left the office, 
we had in excess of two million up¬ 
dates of the product, and 1 think it’s 
an evolving activity for the company. 
We have stated publicly that this up¬ 
coming fiscal year we don’t expect it 
to have a major impact on our rev¬ 
enue model. 

LM: So who is paying for the Red Hat 
Network now? 

MS: It’s a free service right now. 

LM: How will it make money? 

MS: Shortly, through registration. Are 
we smart enough to create enough val¬ 
ue that people would want to pay for 
that service? This is a strategic move 
for our business, because it’s not sim¬ 
ply creating an online service. There 
will be many other strategic initiatives 
related to how we will reposition our 
company to support this. And it’s not 
trivial. When you start telling people 
that you’re going to manage their 5,000 
or 10,000 server environment, and 
that they’re going to be able to have a 
complete snapshot of their entire ar¬ 
chitecture, and that you’re going to 
maintain it and manage everything 
from security to remote systems man¬ 
agement. . .1 think we’re learning a lot. 

So we have a number of very large 
strategic customers that we’re work¬ 


When we bought Cyg- 
nus, they had a 75-per- 
son development effort 
working on a proprie¬ 
tary IDE. It was called 
the Churchill project. 
We cancelled it. 


ing with right now. We’ve been able to 
learn a lot and we continue to learn 
from them how to do this responsibly, 
making sure we don’t shoot ourselves 
in the foot by over-hyping it. 

LM: So you see yourself becoming an 
application service provider (ASP)? 

MS: Absolutely. 


More than 

Money-Motivated 


LM: We’ve been talking a lot lately 
about the relationship between com¬ 
mercial and community interests. I 
have a hard time coming up with the 
names of any developers who have 
come into the Linux community — say 
from IBM — and become well-known 
leaders on the basis of their work. Why 
do you think that is? 

MS: Well, 1 have a funny story. We 
hired a very, very bright developer — 
a very smart young man. And he 
came in after his 90th day at Red Hat 
and said, “1 really believe in the tech¬ 
nical direction of open source,” but it 
turned out that even though he had 
the technical capability to make con¬ 
tributions, he found that access to 
information — and to the leadership of 
the project that he was working on — 
was highly fragmented and it was dif¬ 
ficult to get his ideas heard. 

It’s no different from when you get 
married and have a child. That repre¬ 
sents change. When you have anoth¬ 
er child, that represents more change. 
1 think change is hard for some peo¬ 
ple. What was a somewhat quiet, very 
technically-driven community of peo¬ 
ple using technology for their own 
purposes is now mushrooming into a 
commercial industry. And 1 think what 
has to be taken into consideration is; 
A) What are the long-term benefits of 
expanding out the community? We 
need to recognize that the communi¬ 
ty is going to change. There are social 
and market forces which will cause 
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accesses e-mail on a different comput¬ 
er system from the one where the offi¬ 
cial mailbox is located (the target lo¬ 
cation for the delivery agents). The 
storage location is known as a “mes¬ 
sage store.” The user agent must then 
connect to the message store in order 
to view, access, manipulate, and po¬ 
tentially download the messages, us¬ 
ing the Post Office Protocol (POPS) 
or Internet Message Access Protocol 
(IMAP) for communication. 

Figure One (pg. 58) illustrates some 
of these components and concepts us¬ 
ing a sample mail message sent from 
a user named Hamlet at uwitt. edu 
to his friend Ophelia at ophe624@ 
elsinore.gov. 

Hamlet composes his message to 
Ophelia using a mailer program like 
pine or mutt on one of the common 
workstations in his department (host- 
name philo). Depending on his user 
agent and its exact configuration, it 
will either forward the message to the 
local sendmail process using port 587 
(allowing sendmail to submit it to the 
mail facility), or it may do the submis¬ 
sion operation itself, communicating 
with sendmail via SMTP on port 25 
(the transport agent standard port). In 
our example, pine has been configured 
to function as a submission agent as 
well as a user agent, while mutt relies 
on sendmail for mail submission. 

At this site, all outgoing mail is 
funneled through a single mail relay 
host named apollo. The sendmail pro¬ 
cess on philo passes the message along 
to the corresponding process on apollo, 
which routes it to the Internet. From 
there, the message will eventually be 
sent to ophe624@ elsinore.gov, 
which is diverted (via DNS MX rec¬ 
ords) to some system at the ISP used by 
the elsinore.gov site. 

When convenient, the incoming 
mail server at elsinore. gov [poste) 
connects to the ISP and uses the fetch- 
mail program to retrieve waiting mes¬ 
sages. fetchmail forwards the data to 
sendmail using the SMTP protocol and 
port 25, thereby simulating normal in¬ 
coming TCP/IP mail. The sendmail 
process on poste sends the messages 


for user ophe624 to the sendmail pro¬ 
cess on polonius, where the procmail 
program places it in the correct mail¬ 
box on host polonius [/var/spool/mail/ 
ophe624 ). 

From the point of view of the send¬ 
mail transport agent, the mail is now 
delivered. However, Ophelia still has 
not seen the message. She reads her 
mail on her laptop. To do so, she has 
configured the mail program in Net¬ 
scape to connect to the message store 
(her mailbox) on polonius, providing 
the appropriate username and pass¬ 
word for authentication. Netscape will 
then display information about the 
messages in her mailbox, showing her 
the actual message when requested, 
retrieving all data via the IMAP proto¬ 
col. Ophelia can delete the message, 
download it to her laptop, or file it 
away into one of her mail folders on 
polonius (or even leave it in her in¬ 
coming mailbox). 

If the site elsinore.gov had a 
direct Internet connection, the initial 
delivery of mail message to their site 
would be somewhat different. Instead 
of using fetchmail to retrieve messages 
from a remote ISP site, mail would ar¬ 
rive at the site’s firewall. In this case, 
a daemon that forwarded SMTP pack¬ 


ets to a designated host inside the fire¬ 
wall {poste could again be used for 
the latter) would run on the firewall. 
Such a daemon is known as an SMTP 
proxy; the most widely used SMTP 
proxy facility is the combination of 
smtpd (to receive and store incoming 
SMTP data) and smtpfwdd (to forward 
SMTP data to the incoming mail serv¬ 
er) from www.obtuse.com. 

Mail Address Subtleties 

So far, we have considered only the 
most straightforward mail-addressing 
scenario — a message is addressed to 
a user at a particular site. However, 
some complications can arise: 

> DNS MX records can redirect mes¬ 
sages directed at some host to a dif¬ 
ferent host. 

> E-mail aliases can redirect incoming 
messages for a user to a different 
host and/or user (or even group of 
users). 

> Mail-forwarding mechanisms can 
also redirect mail to a different des¬ 
tination address (typically used for 
users who are away from their home 
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site for an extended period or have 
left an organization altogether). 

We will consider each of these in turn. 

MX Records 

DNS MX records specify the host that 
handles e-mail for a designated com¬ 
puter system. They cause e-mail to that 
host to be preempted and rerouted to 
the new destination system. MX rec¬ 
ords have the general format: 

host [ttl] IN MX n destination 

where host is the computer to which 
the record applies, n is a number in¬ 
dicating the record priority (lower 
numbers indicate higher priority), and 
destination is the name of the host 
to which mail should be redirected 
(note that it can be the same as the 
host itself), (ttl is the usual optional 
time-to-live parameter applying to DNS 
caching. In case you need it, you can 
find a more general overview of DNS 
on our Web site at http://www.linux- 
mag.eom/2000-09/dns_01 .html.) Fig¬ 
ure Two shows some examples of this. 

Host dal ton normally receives its 
own mail since it is listed as its own 
highest-priority destination host. If 
dal ton is unavailable, mail will be 
redirected first to host postal and 
then to host remote.mysite.com. 
In contrast, e-mail destined for host 
newton is redirected to host apple un¬ 
der normal circumstances. If apple 
is unavailable, mail will go to postal 
instead. Thus, postal serves as a 
backup mail server for both hosts (and 
may do so for an entire network). 

The final two lines specify a default 
mail destination system for mail ad¬ 
dressed to anyuser@mysite.com; 
by default, mail will go to the system 
granada, which serves as the incom¬ 
ing mail server for that site. System 
laguna is specified as a backup. 

Mail Aliasing 

Mail aliases are another way of rerout- 
ing e-mail. In contrast to DNS MX rec¬ 


ords, these operate on a per-user basis. 
Mail aliases are defined in the file /etc/ 
aliases; this feature is part of the send- 
mail package (and also of other trans¬ 
port agents). Note that some mailer 
programs also allow personal mail ali¬ 
ases to be defined, but these apply only 
to outgoing messages and won’t be 
considered here. 

Entries in the aliases file have the 
following format: 

name: user [, user ...] 

Here are some example entries: 

aef: aefrisch 

aefrisch: aefrisch@dalton 
max: \maxwell@newton 

chem.: aef, chavez, jones 
phys: aef, enzo, nadia 
science: chem., phys, max 
jones: djones@stockmkt.com 

The first two entries illustrate user 
account aliases. In this case, mail for 
aef would be redirected to aefrisch. 
The name aefrisch is itself an alias 
and expands to aef risch@dalton, 
so mail coming to this system for aef 
would go to aef risch@dalton (at 
least to start with). Note that aliases 
continue to be expanded as long as is 
necessary. The third entry defines an 
alias for max: maxwell@newton. 
This is a terminal alias; the initial back¬ 
slash prevents any further expansion. 

The second group of sample entries 
is used to define some mailing lists. 
The first two lists have three members 
each. The third list, science, has 


two other mailing lists as its members 
(along with max). Any duplicates in 
the resulting list will automatically be 
removed by sendmail Note also that 
entry order is irrelevant in the aliases 
file. Thus, the alias jones does not 
need to precede its use in the chem 
mailing list. 

Whenever you edit the aliases file, 
you must convert the text file to the 
actual binary databases used by send¬ 
mail by running the newaliases com¬ 
mand (equivalent to sendmail -bi). 
Aliases may also be used to redirect 
mail to a file or a program; we will not 
concern ourselves with these capabil¬ 
ities here. 

Forwarding Mail 

Mail forwarding is the third mail-redi¬ 
rection mechanism we will consider. It 
is very similar to mail aliasing. There 
are two main mechanisms for accom¬ 
plishing it. First, a file named .forward 
may be created in a user’s home direc¬ 
tory. It should contain one or more e- 
mail addresses to which e-mail should 
be forwarded (the simplest format is to 
put each address on a separate line). 
For example, if the .forward file in user 
Chavez’s home directory contained 
the single line ruiz@umexico.edu, 
then her e-mail would be forwarded 
to the specified address. If she wanted 
to keep a local copy of the mail as well, 
she could use this .forward file: 

ruiz@umexico.edu 
"/home/chavez/mail_pile" 

This file would forward the mail to 


62 MAY 2001 


WWW.LINUX-MOB.COM 





























































the same address and also place a copy 
of each forwarded message into the 
file mail^ile in her home directory. 

The second mail-forwarding mecha¬ 
nism is an internal feature of sendmail 
and we will discuss it next month. 

Putting It All Together 

How do all of these separate pieces in¬ 
teract to affect mail delivery? Basical¬ 
ly, at each attempted delivery host, MX 
records are examined to see whether 
e-mail is rerouted at the DNS level or 
not. If so, the mail is sent to the same 
user at the new host, whose own MX 
records are then checked. 

If no MX record has an effect, then 
the address is examined for aliasing 
via the aliases file and then the for¬ 
warding mechanism. Either of these 
has the potential to redirect the mail 
to a different user and/or host. If the 
host changes, the message is routed 
to the specified host, where MX record¬ 
checking occurs again. 

If all of the aliasing does not redirect 


the message to a different host, then 
the message gets delivered to the final 
resulting user on the local system. 

Another example should be able to 
make this clearer. Suppose a message 
is addressed to jane@doe.com. It 
arrives first at the incoming mail serv¬ 
er pof f ice. doe. com (designated by 
the MX record for the domain itself). 
At this point in time, the MX records for 
pof f ice are examined, and its high- 
est-priority record redirects the mail 
to host sorter. Thus, the address 
now becomes jane@sorter.doe. 
com, and the mail is redirected at the 
DNS level. 

Now suppose sorter’s MX record 
points to itself, but an alias on that sys¬ 
tem defines jane as jane@incognito. 
The address now becomes jane@ 
incognito, and the mail is transport¬ 
ed accordingly. Host incognito in 
turn has an MX record pointing its mail 
to erewhon, so the address becomes 
j ane@erewhon (and the sendmail 
process on incognito never handles 
the message). 


Finally, on erewhon (which has an 
MX record that points to itself), jane 
is aliased as j smith. User j smith 
has a .forward file which consists of 
the entry kjones@farawaY.org. 
So, the mail is then readdressed to 
kj ones@f araway. org, and the var¬ 
ious sendmail processes in this do¬ 
main send it back out onto the Inter¬ 
net. When the message finally arrives 
at faraway.org, the entire process 
begins again. 

More Next Month... 

Hopefully, the information in this col¬ 
umn has given you a good feeling for 
what is involved in making an orga¬ 
nization’s mail system work success¬ 
fully. Next month, we will consider 
many of these concepts in more detail 
as we discuss configuring sendmail for 
various, common uses. 


j^leen Frisch is the author of Essential 
System Administration. She can be 
reached at aefrisch@lorentzian.com. 
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GOMPIIE TIME 

The fihers oi Threads 

By Benjamin Chelf 


F or the last several months in this column, we’ve been 
looking at programming with Linux’s threads library, 
pthreads. However, we have taken for granted the work 
that is actually done under the covers by the pthreads 
libraries. So this month’s Compile Time will dissect Lin¬ 
ux pthreads themselves to discover exactly what it is that 
makes them tick. 



Before we dive in and start looking at this topic though, 
you’ll probably find it a lot easier to follow if you are 
already familiar with a couple of other concepts. First, we 
assume that you have an understanding of the difference 
between code that runs in “privileged mode” (i.e., kernel 
space) and code that runs in “user mode” (i.e., user space). 
It’s also important that you understand how system calls 
work and how they switch between user mode and privi¬ 
leged mode. If you need to brush up on these topics, a good 
introduction can be found in the May 1999 Compile Time, 
located on the Web at: http://www. linux-magg.com/1999- 
05/compile_ Ol.html. 

There are three basic ways that threads can be imple¬ 
mented on a system: many-to-one, one-to-one, and many- 


to-many. Each method requires a different amount of sup¬ 
port from the operating system and has its own strengths and 
weaknesses. The names of the methods refer to the number 
of threads the application ‘sees’ in user space compared to 
the number of threads (i.e., processes) the operating sys¬ 
tem sees in kernel space. 

Many-to-One 

In a many-to-one implementation of threads, the threads are 
completely written in user space. From the kernel’s point 
of view, there is only one process executing. Although that 
process is multi-threaded, to the kernel it looks the same as 
any other non-threaded process. The advantage of this meth¬ 
od is that it requires no additional support from the kernel 
and therefore can be implemented on any system. All the 
thread management issues (including scheduling) are han¬ 
dled in user space by the application. 

Interestingly, the many-to-one implementation’s greatest 
strength just happens to be its greatest weakness as well. Be¬ 
cause the operating system views the multi-threaded appli¬ 
cation as a single process, that application can never take 
advantage of additional processors if they exist. The multi¬ 
threaded application is guaranteed to run only on a single 
processor even if additional resources are available. 

In fact, in many cases, the multi-threaded application will 
not even act like a multi-threaded program at all. For exam¬ 
ple, if one of the threads is waiting for a system call to 
return, the entire application must also wait! When a system 
call executes, the calling process is required to block until 
it completes. Therefore, in a many-to-one implementation, 
all threads will stop executing when any one of them needs 
to switch into kernel space. This is intolerable behavior in 
a threaded application (e.g., imagine if all the windows in 
your GUI froze up when the application was waiting for 
user input!) and, therefore, this implementation is not real¬ 
ly a solution to the problem of implementing threads. 

One-tO’One 

The one-to-one implementation of threads solves the two 
problems of the many-to-one implementation listed above. 
In this implementation, every thread in a multi-threaded 
application is its own process in the kernel. This implemen- 
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Hgure llivo: Prototspe for cloneO 

int_^clone (int (*fn) (void *arg), void *child_stack, int flags, void *arg) 


The Unux Way 


tation is often simpler than the many-to-one implementa¬ 
tion because it allows the kernel to perform the scheduling 
of the threads just as it does for other processes. Also, if the 
machine on which the multi-threaded application is running 
has multiple processors, the operating system can schedule 
each thread to run concurrently on different processors. 

Of course, since each thread is its own process, they need 
to not be blocked by the operating system when another 
one of them switches into kernel space. Unlike the many- 
to-one method, this implementation requires some support 
from the operating system. Recall that threads in a multi¬ 
threaded application share the same memory while execut¬ 
ing. Therefore, the kernel must provide a means for creating 
new processes that share memory. 

Finally, because each thread is its own process, many of 
the synchronization techniques (e.g., semaphores and con¬ 
dition variables) carry a large overhead cost due to context 
switching between user space and kernel space. For exam¬ 
ple, when waking up a set of threads that are waiting on 
the condition, a switch between kernel space and user 
space and back again must occur to wake up each thread. 
The associated overhead of this operation is two times the 
number of threads waiting times the cost of a context switch. 
Not cheap. 

Many-To-Many 

The many-to-many implementation of threads is nice be¬ 
cause it takes the best ideas from both the one-to-one and 
many-to-one methods while avoiding many of their 
disadvantages. In the many-to-many model, many 
kernel processes execute, and each process represents 
a scheduler that picks a thread to run. Basically, each 
process acts as its own many-to-one implementation 
of threads by scheduling different threads to run with¬ 
in that kernel process. 

Having multiple processes coordinate to do this 
solves the problem of all threads being blocked when 
one thread makes a system call and switches into ker¬ 
nel space. In the many-to-many model, the other ker¬ 
nel processes can still schedule threads to run. Also, 
the problems with context-switch overhead are miti¬ 
gated because each process performs the switches be¬ 
tween execution of threads. As a result, this switch¬ 
ing happens entirely in user space. 

Of course, all this functionality comes with a price 
— this method is the most complicated to implement 
of the three and requires kernel support for the rela¬ 
tionship between kernel threads and user threads. It 
is the most common implementation on commercial 
Unix systems (e.g., Solaris, Digital Unix, and IRIX). 


The Linux implementation of pthreads 
follows the one-to-one method. The 
kernel does not support the functionality required for a 
many-to-many implementation, and since context-switches 
in Linux are relatively fast, that disadvantage of the one-to- 
one method is much less of a problem. Linux also provides 
the mechanism necessary to create a new process that 
shares a memory space. You are probably familiar with the 
fork () system call that creates a new process based upon 
the calling process. Linux provides another system call, 
_clone () , that is more general than fork (). 

Where fork () only gives the child process a copy of the 
state of the parent process, clone () can be used to create 
a new process that shares or copies resources with an exist¬ 
ing process. You can share or copy the memory map, file sys¬ 
tems, file descriptors, and signal handlers of the existing 
process. The fork () system call is essentially a special case 
of clone () where none of the resources are shared. Let’s 
take a closer look at the clone () system call. Its prototype, 
as found in <sched.h>, is listed in Figure T\vo. 

Notice that, unlike fork () , clone () takes in a function, 
fn, to be executed. This is the first argument to the call. 
When clone () successfully completes, f n will be execut¬ 
ing simultaneously with the calling function. 

The child_stack argument specifies where the child 
process should start its stack. Since it is possible for the child 
and the parent to share a memory map, the parent is re¬ 
sponsible for allocating space for the child process’s stack. 
The parent and child can execute different functions after 
the call to clone (), so they cannot share a single stack. 

The flags argument indicates exactly which parts of the 


Tahie Ones nags for cloneO 

Flag Description 

GLONE_VM Share the memory between the parent and child 

process. If this flag Is not set, the memory will be 
copied as is the case with fork c) 

Share the file system information. A call to a func¬ 
tion like chdir ( ) will have an effect on both the 
child and parent process regardless of the caller. 

Share file descriptors. Any newly created file des¬ 
criptors after the clone o will be valid in both 
child and parent processes. 

Share signal handlers. All signal handlers set up 
by either parent or child after the clone () are 
common to both. 

Share the process ID. The ehild and parent pro¬ 
cess will have the same pid. Should not be used 
with Linux kernel versions after 2.1.97. 


CLONE_FS 


CLONE_FILES 


CLONE_SIGHAND 


CLONE_PID 
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that to happen, whether we like it or 
not. And B) How do you make sure 
that the technology advances along the 
principles and the values of the origi¬ 
nal open source community? 

LM; So what comes first for you? What 
if your board of directors decided that 
Red Hat had to begin selling propri¬ 
etary software? 

MS: [laughing] What is the upside for 
me to answer that question? I think it’s 
a personal choice. For me it’s not some¬ 
thing I would want to participate in. 
Selling proprietary software puts me 
in no different position than all kinds 
of companies selling widgets out there. 
It’s the commitment to open source 
that differentiates us. 

My personal goal was never money. 
And I think when I came to Red Hat 
there was a lot of suspicion. I remem¬ 
ber sitting down with Mark Ewing and 
him saying, "you are going to change 
this into a capitalist organization.” 

I believe that what’s at stake right 


now is the whole notion of how infor¬ 
mation will be available for the next 
generation of citizens, whether they 
be in Germany or Japan or the United 
States. In the United States right now, 
a lot of that policy is being formulat¬ 
ed and being discussed without both 
parties sitting at the table. With [Mi¬ 
crosoft VP] Jim Allchin’s recent com¬ 
ments to US Senators, the Senate only 
got one viewpoint. There was no open 
source representative to challenge his 
statements and his opinion. There are 
policy decisions being made on the 
state and federal levels. If the open 
source community is not able to estab¬ 
lish a broader platform, then we will 
be forced to live with decisions that are 
being made. 

As an example. Red Hat spends a 
fairly large sum of money now to bat¬ 
tle UCITA (Uniform Computer Infor¬ 
mation Transactions Act). But that’s 
only one small element. There are 
many more. And the proprietary ven¬ 
dors are having a relatively easy time 
with all of their lobbying efforts be¬ 


cause the open source community has 
not been able to galvanize itself to 
insure that our views are properly rep¬ 
resented in Congress. 

LM: There is a sense in the open 
source community that the political 
process has been irrelevant to the de¬ 
velopment of important technologies 
like the Internet. Are you in dialogue 
with people in the open source com¬ 
munity about this? 

MS: I have tried to broach this topic 
with other CEOs in the open source 
industry and it didn’t go too far. 

LM: Why not? What did they want to 
talk about? 

MS: Red Hat’s dominance of the dis¬ 
tribution market, which I think is com¬ 
pletely irrelevant. 


Robert McMillan is editor at large with 
Linux Magazine. He can be reached at 
bob @ linux-mag. com. 
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By Craig Hunt 


say that any sufficiently advanced technology 
is indistinguishable from magic, and it’s not hard to see why. 
When you think about the incredible amount of advanced 
technology that makes it possible to view a Web site or send 
an e-mail to anyone in the world, it can definitely seem like 
magic. However, as we all know, there is no magic in the 
network, just basic engineering. 

All networks are composed of computers that are connect¬ 
ed to each other via a shared electrical connection (i.e., a 


wire). A computer can only communicate directly with other 
computers that share the same physical network. The magic 
of the Internet is that it makes possible communication be¬ 
tween computers on separate physical networks. To do this, 
a router is needed to interconnect these networks. Routers 
are computers that contain some intelligence about the topo¬ 
logy of the network and have the ability to forward (“route”) 
packets between the networks they are aware of. Without 
routers, your computer could not communicate with a com¬ 
puter on the other side of town, let alone on the other 
side of the world. 

Figure One shows three separate networks. Because 
computers can only communicate directly if they share 
a network, computer A can talk to B, but A cannot talk 
to C or D. B can talk to systems A and C, but not to 
D. C can talk to B and D, but it can’t talk to A. D can 
talk to C, but not to any of the other systems. This is 
not a global network! A must rely on system B to 
deliver a message to D. B in turn sends the message 
to system C, counting on it for delivery. C then sends 
the message to D. Thus, in Figure One, computers B 
and C are routers. They link together the different phys¬ 
ical networks and forward messages between them. 

It’s worth keeping in mind that even though routers 
are required for computers to communicate between 




Figure One: Three separate physical networks linked with routers. 
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Shuttling Packets around the 
Internet with RIP and RIPv2 


networks, routers are not 
the only machines that 
make routing decisions. 

Every network device that 
uses the Internet Proto¬ 
col (IP) makes routing de¬ 
cisions. How does this 
work? Well, in simplified 
terms, when a Linux sys¬ 
tem has a packet to deliv¬ 
er, the destination address 
of the packet is looked up in a routing table. The routing 
table tells the system whether the packet should be delivered 
directly to a computer located on this physical network or 
if it needs to be forwarded to a different physical network. 

Table Based Routing 

At this point, it’s probably a good idea to take a look at this 
routing table. While we’ve included the routing table from 
one of our systems (running Red Hat 7) in Listing One, you 
can easily view the routing table for your own computer. Just 
use the route command with the -n option, and it should 
come right up. The -n option prevents route from converting 
IP addresses to host names, which creates a clearer display. 


Use Iface 

0 ethO 

0 ethO 

0 lo 

0 ethO 


As you can see in Listing One, each entry in the routing 
table starts with a Destination value. The Genmask field 
is the bit mask that will be applied to the destination address 
of the packet to see if it matches the Destination value 
in the table. For example, the address 17 2.16.50.183 
would match the second entry in this table because perfor¬ 
ming a logical AND of that address with the Genmask of 
255.255.255.0 yields 172.16.50.0. 

When an address matches an entry in the table, the 
Gateway field tells the system how to reach the specified 
destination. If the Gateway field contains the IP address of 
a router, then that router is used. If the Gateway field con¬ 
tains all zeros (0.0.0.0} or an asterisk (*), the destination 
is a directly connected network, and the “gateway” is the 


listing One: Sample Routing Table 

# route -n 

Kernel IP routing table 


Destination 

Gateway 

Genmask 

Flags 

Metric 

Ref 

172.16.55.0 

0.0.0.0 

255.255.255.0 

U 

0 

0 

172.16.50.0 

172.16.55.36 

255.255.255.0 

UG 

0 

0 

127.0.0.0 

0.0.0.0 

255.0.0.0 

U 

0 

0 

0.0.0.0 

172.16.55.1 

0.0.0.0 

UG 

0 

0 
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computer’s network in¬ 
terface. The last field for 
each table entry is the 
network interface used 
for the route (iface). In 
this example, it is either 
the first Ethernet inter¬ 
face (ethO) or the loop- 
back interface (lo). 

The remaining four fields display supporting information 
about the route. The Ref field shows the number of times 
the route has been referenced to establish an outbound con¬ 
nection, and the Use field shows the number of packets 
transmitted via the route. The Flags field describes certain 
characteristics of the route, such as U, which means the route 
is up (i.e., it’s “live”), and G, which means the route uses 
an external gateway. The Metric field shows the cost of 
using the route. Routing metrics are used by the routing 
protocols to determine the “cheapest” way to reach a given 
destination. 

The first line in the sample table defines the connection 
of this host to the local Ethernet. This entry tells us that the 
local network is 172.16.55 .0 and that the host connects 
to it through interface ethO. The second line tells us that 
172.16.55.36 is the gateway to network 172.16.50.0. 
The third line defines the loopback network and states that 
the gateway to it is the interface lo. Finally, the last line 
defines the default route, as indicated by the destination 
value 0.0.0.0 (Destination contains the keyword “default” 
on some systems) and the Genmask value 0.0.0.0. If the 
destination of a packet does not match a specific route, the 
packet is sent to the default gateway. 

On most networks, the only system with a very complex 
routing table will be the router itself. Host computers tend 
to have much simpler, static routing tables that only con¬ 
tain three routes: 

> The loopback route 

> The route to the local network 

> The route to the default router 

These three routes are statically defined by the system 

A _ 


CREATING A ROUTER 


By default, Linux computers do not forward packets between 
networks (a primary function of routers). The process of doing this 
is called IP forwarding. To get a Linux system to act as a router, 
you must enable IP forwarding by setting /proc/sys/net/ipv4/ 
ip_forward to 1 as follows: 

echo "1" /proc/sys/net/ipv4/ip_forward 

Store this command in a startup file, such as rc.local, to en¬ 
sure that IP forwarding is enabled at every boot. 


Use Iface 

0 ethO 

0 ethO 

0 lo 

0 ethO 


administrator by either answering configuration questions 
during the initial installation or by using the route com¬ 
mand to manually add routes to the routing table (which 
we’ll take a look at in a minute). This static table rarely 
changes once it is created. (Although Linux systems are 
most often configured as hosts, this does not have to be the 
case. See the Creating a Router sidebar for information about 
the switch that causes a Linux system to act as a router.) 

Adding a Static Route 

IP relies on the routing table to direct packets to their des¬ 
tinations, but IP does not build the routing table. Routes 
enter the routing table in one of two ways — either the sys¬ 
tem administrator enters them as static routes, or they are 
added to the table dynamically by a routing protocol. Man¬ 
ually adding static routes works very well when a single de¬ 
fault route is used, but building the complex routing tables 
needed by routers requires a dynamic routing protocol. 

The route command adds or deletes entries in the rout¬ 
ing table. For example, to add the route 129.6.0.0 to the 
routing table, you would issue the command: 

# route add -net 129.6.0.0 netmask 

255.255.0.0 gw 192.168.0.3 dev ethO 

In the sample command, the keyword add tells route to 
add a new route to the table. The -net value is the desti¬ 
nation address of the network reached via this route. The 
netmask value is the address mask that will appear in the 
Genmask field when the routing table is displayed. The gw 
value, which will appear in the Gateway field of the rout¬ 
ing table display, is the address of the external gateway 
through which packets are sent to reach this destination 
address. Finally, the route command permits you to speci¬ 
fy the network interface to use for the route. Generally, 
there is no need to define the interface, because the system 
will choose the correct interface to reach the specified router 
by default. However, the dev option exists so you can de¬ 
fine the interface yourself if you want. These four items — 
the destination, the address mask, the gateway, and the 
interface — are the basic components of a route. After enter¬ 
ing the route, you can issue the command route -n; again, 
you would see the output in Listing Two. 

The route command also accepts an argument called 
metric, which assigns a “cost” to the route. Static routing 


Listing Two: Updated Routing labie 

# route -n 

Kernel IP routing table 


Destination 

Gateway 

Genmask 

Flags 

Metric 

Ref 

192.168.0.0 

0.0.0.0 

255.255.255.0 

U 

0 

0 

129.6.0.0 

192.168.0.3 

255.255.0.0 

UG 

0 

0 

127.0.0.0 

0.0.0.0 

255.0.0.0 

U 

0 

0 

0.0.0.0 

192.168.0.1 

0.0.0.0 

ug: 

0 

0 
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uses the metric to sort duplicate routes in the routing table. 
However, duplicate routes have no real use in static routing 
because the system stops searching the routing table on the 
first match. This means that even if a given route is down 
and a router with a slightly higher metric is up and run¬ 
ning, static routing will always send packets to the router 
that is down. Obviously, this is not good. However, it’s not 
a major issue, because dynamic routing makes real use of 
routing metrics in order to avoid this problem. 

Dynamic Routing Protocols 

Routing protocols perform two functions — they select the 
“best” routes and communicate those routes to other routers 
on the network. Thus, a routing protocol is a recipe for de¬ 
fining and for disseminating routes. 

Routing protocols are differentiated by the method they 
use for determining the best route and by the technique 
they use for distributing routing information. There are 
only two major algorithms used to select the “best” route: 

> Link state algorithms allow routers to build a database 
that assigns a cost to every link in the network. A link 
state protocol selects the route that has the lowest total 
link cost as the best route. Open Shortest Path First (OSPF) 
is an example of a link state protocol. 

> Distance vector algorithms use a metric that represents 
the number of routers through which the packet must tra¬ 
vel. The fewer routers that must handle the packet, the 
more preferred the route. Routing Information Protocol 
(RIP) is an example of a distance vector protocol. 

RIP is the routing protocol traditionally used by Unix sys¬ 
tems. It is easy to explain and understand, so it is a good 
place to start a study of routing protocols. Additionally, RIP 
provides excellent examples of the technical problems and 
challenges that routing protocols present to software devel¬ 
opers and network administrators, and for these reasons, 
we’re going to devote the rest of this article to looking at it. 

Routing Information Protocol 

RIP is the original routing protocol used on Unix systems 
and is still included in many Linux distributions. It defines 
the “best” route as being the route with the lowest routing 
metric. The RIP routing metric is a number from 1 to 15 
that represents the number of routers that traffic must pass 
through. Each router is referred to as a “hop.” 

When RIP starts, it broadcasts a request for routing infor¬ 
mation. Another router running RIP responds to the request 
by sending an update packet that contains the destination 
addresses and associated metrics it has in its own routing 
table. In addition to responding to requests, RIP routers is¬ 
sue updates every 30 seconds. If a router stops issuing up¬ 


dates for 180 seconds, the other routers on the network as¬ 
sume it is dead and delete any routes that go through it. 
Figure Tlvo illustrates the format of a RIP update packet. 

It’s worth taking a moment to examine the fields in the 
RIP packet. The command field either contains a 1 if this is 
a request packet or a 2 if it is a response packet. The ver - 
si on field always contains a 1 for basic RIP, and the ad¬ 
dress family field always contains a 2, which indicates that 
the packet uses IP addresses. The last four word-length fields 
in Figure Two contain a destination address, two words of 
zeros, and a metric that shows the cost of reaching the des¬ 
tination through the router that sent out the update. These 
four words are repeated for every destination and metric in 
the router’s routing table. 


0 1 2 3 3 

01234567890123456789012345678901 



Figure Two: The format of a RIP update packet. 


When a router receives an update packet, RIP processes 
it in the following manner: 

> If the update contains new routes that are not in the 
routing table they are added. 

> If the update contains routes that are of lower cost than 
the same routes in the existing routing table, the new 
routes are used. The cost of a new route is determined 
by adding the cost of reaching the router that sent the 
update to the cost metric included in the update packet. 

> If the update contains routes that have a cost of 15, 
those routes are deleted from the routing table if the 
update came from the gateway used for those routes. 
For example, if the routing table contains a route to 
network 17 2.16.5 0.0 through gateway 17 2.16.5 5 . 
36, and it receives a RIP update from 17 2.16.55.36 
with a cost of 15 for the route to 172.16.50.0, the 
route is deleted. 

Most Unix systems, and many Linux systems, use the 
routed (pronounced “Route ‘D’,” as in daemon) program to 
run RIP. When routed starts, it issues a request for routing 
updates and then listens for responses. If it is running on a 
computer with more than one network interface, routed also 
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responds to RIP requests with an update packet. Use the - q 
option to prevent routed from issuing updates. 

routed reads information from /etc/gateways to build the 
routing table. The most common use for the /etc/gateways 
file is to define a default route, as in this example: 

net 0.0.0.0 gateway 17 2.16.12.1 metric 1 active 

This entry starts with the keyword net followed by a net¬ 
work address. (The destination address 0 . 0 . 0 . 0 is used 
for the default route.) Next is the keyword gateway fol¬ 
lowed by the gateway's address and the keyword metric 
followed by the cost of the route. All /etc/gateways entries 
end with either the keyword passive or active. A 
passive route is a permanent static route placed in the 
routing table and kept there as long as the system is up. An 
active route can be updated by RIP. active routes are 
used to “prime the pump” during the RIP startup phase, with 
the expectation that the routes will be updated when the 
protocol is up and running. 

/etc/gateways is the only configuration file for routed, 
and it is rarely needed. On most systems, routed learns all 
it needs to build the correct routing table via the RIP pro¬ 
tocol. It does not require manual configuration. 

RIP is a simple protocol, and routed is a simple program. 
However, simplicity has a price. RIP has three fundamental 
limitations: 

> Its network diameter is limited to 15 hops. 

> It cannot send network bit masks with routing updates. 

> It suffers from slow convergence (meaning it can take a 
long time for the routing table to reflect the current state of 
the network). Figure Three helps illustrate this problem. 

Slow Convergence 

In order to really understand the problems behind slow con¬ 
vergence and the techniques used to address them, you need 
to understand a problem known as “count-to-infinity.” The 


problem goes something like this; in Figure Three, the c- 
router reaches network 1 through b-router and then through 
a-router. Network 1 is two hops away from c- router and 
one hop away from b-router. Therefore, b-router advertises 
a cost of 1 for network 1, c-router advertises a cost of 2, 
and traffic is routed through b-router. This is all fine and 
dandy until something goes wrong. 

Think about a scenario like this; if a-router crashes, b- 
router will wait for an update from a-router for 180 sec¬ 
onds. While waiting, b-router continues to send updates to 
c-router that keep the route to network 1 in c-router's rout¬ 
ing table. When b-router's timer finally expires, it removes 
all routes through a-router from its routing table, including 
the route to network 1. It then receives an update from c- 
router advertising that c-router is two hops away from net¬ 
work 1. b-router installs this route and announces that it is 
three hops away from network 1. c-router receives this up¬ 
date, installs the route, and announces that it is four hops 
away from network 1. This continues until the cost of the 
route to network 1 reaches 15 in both routing tables. If the 
update interval is 30 seconds, this could take a long time! 
RIP deals with the problem of counting to infinity by em¬ 
ploying two techniques — split horizon and poison reverse. 

Split horizon prevents a router from advertising routes on 
the link from which those routes were obtained. This solves 
the problem described above, because c-router does not an¬ 
nounce the route to network 1 on network 3 and therefore 
does not confuse b-router with bad updates. While this fea¬ 
ture works for the example described above, it does not 
work for all count-to-infinity problems (more on this later.). 

Poison reverse makes a router advertise routes with an 
infinite distance on the link from which the routes were 
obtained. With poison reverse, c-router advertises network 
1 with a cost of 15 to all systems on network 3 to positive¬ 
ly state that network 1 cannot be reached through c-router. 

Split horizon and poison reverse solve the problem de¬ 
scribed above. But what happens if c-router crashes? Again, 
refer to Figure Three. Because of split horizon, d-router and 
e-router do not advertise to c-router the route to network 3 
because they learned the route from c-router. They do, how¬ 
ever, advertise the route to network 3 to each other. When 
c-router goes down, d-router and e-router perform their own 
count to infinity before they remove the route to network 
3. This problem can be addressed using a technique known 
as “triggered updates.” 

With triggered updates, when an external router crashes 
or a local link goes down, the local router immediately sends 
an update to its neighbors. This update advertises the routes 
with infinite cost that were deleted from the local router's 
routing table and tells the neighbors to also remove them. 
With triggered updates, neighbors are informed of changes 
quickly; bandwidth is also used efficiently, because trig¬ 
gered updates include only the routes that have changed. 

For an example of how this works, let's look again at Fig¬ 
ure Three. If c-router crashes, e-router and d-router wait 180 
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FOR MORE INFORMATION 


seconds and remove the routes to networks 1,2, and 3 from ^ 
their routing tables. They then send each other triggered 
updates with a metric of 15 for networks 1, 2, and 3. Thus, 
they tell each other that they cannot reach these networks, 
and no count to infinity occurs. 

Split horizon, poison reverse, and triggered updates han¬ 
dle most slow convergence problems. They do not, howev¬ 
er, increase the RIP network diameter or add support for net¬ 
work bit masks. Another major drawback is that RIP can¬ 
not disseminate the network bit masks needed to properly 
interpret routes. This problem alone makes RIP a poor choice 
for modem networks. Fortunately, an updated version of RIP, 
known as RIPv2, solves this problem. 

RIPv2 

RIP Version 2 (RIPv2) adds a “network mask” field and a 
“next hop address” field to the original RIP packet. Remark¬ 
ably, RIPv2 adds these capabilities while remaining com¬ 
pletely compatible with RIP. RIP and RIPv2 routers can co¬ 
exist on a single network without any problems. All of the 
features of RIPv2 are implemented in unused fields of the 
original RIP packet, as shown in Figure Four. 

The command, version, address family, IP address, and 
metric fields are exactly the same as those used in basic 
RIP, except this time the version field contains a 2. The sub¬ 
net mask field contains the network bit mask associated with 
the destination, and the “next hop address” field provides 
the address of the gateway. In basic RIP, the gateway is 
always assumed to be the router that sends out the update. 

The next hop address field specifically identifies the gate¬ 
way to be used with that packet, allowing a RIPv2 router 
to provide updates for routers that don’t run RIPv2. If the 
next hop address is 0.0.0.0, the router that sends the 
update is assumed to be the gateway for the route. 

The two remaining fields, routing domain and route tag, 
have limited utility. Route tag is not used by RIPv2. The 
routing domain value is the process number of the RIPv2 
process that issued this update if the router runs multiple 
RIPv2 processes. Routers do not really run multiple RIPv2 
processes, so this field always contains 0. 

In addition to support for address masks, RIPv2 uses mul¬ 
ticasting to reduce the load on systems that do not want 

8 1 2 3 3 

0123456789012345678901234567898 1 




Figure Four: Format for RIPv2 update packet. 
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RIPv2 updates; RIPv2 also provides an authentication 
scheme to prevent accidental updates from misconfigured 
hosts. RIPv2 is the only version of RIP that is suitable for 
use on a modern network. 

Whereas routed is the program that implements RIP, you 
would use the gated program to run RIPv2. gated actually 
combines several different routing protocols in a single soft¬ 
ware package. This means that the routing table can be built 
using multiple protocols and routing policies can be imple¬ 
mented that prefer routes learned from one protocol over 
those from another. Needless to say, with all that flexibili¬ 
ty comes a fair bit of complexity, and for that reason, con¬ 
figuring gated is outside the scope of this article. Check out 
the gated man page for more information. Refer to the For 
More Information sidebar for additional sources. 

Still Not Perfect 

Despite its improvements, RIPv2 is still RIP and still con¬ 
tains some of the same limitations. For example, it uses the 
same distance-vector algorithm for determining the best 
route and therefore limits the diameter of the network to 15 
hops. The only way to get around this limitation is to use 
a protocol that employs a different algorithm. The best 
example of this is the link state protocol OSPF (Open Short¬ 
est Path First), which is used for large national networks. If 
you’re interested in learning more about OSPF, please 
check out the link in the For More Information sidebar. Still, 
if you’re just experimenting with routing, or want to con¬ 
vert your Linux box into a simple network router, RIPv2 
should be more than adequate for the job. 


Craig Hunt is the best-selling author of O'Reilly & Asso¬ 
ciates’ Internetworking with TCP/IP. He can be reached at 
craig. hunt® wrotethebook. com. 
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Administering E-mall 

By JEleen Frisch 


M aking sure that users’ electron¬ 
ic mail gets sent out and deliv¬ 
ered is one of the system ad¬ 
ministrator’s most important 
jobs, and it’s also one that be¬ 
comes extremely visible should things 
go wrong. Inevitably, administering e- 
mail is time-consuming and frustrat¬ 
ing, at least intermittently. 


This column begins a three-part look 
at some key aspects of the usual Linux 
electronic mail system. This month, we 
will begin with an introduction to how 
electronic mail gets created and look at 
some of the complexities involved in 
mail addressing. In future months, we 
will take a look at the key component 
responsible for most aspects of mail 
transportation and discuss how elec¬ 
tronic mail may be filtered. 

Parts of the Mall System 

As with regular postal mail, a fully 
functioning electronic mail system de¬ 
pends on a series of distinct, and often 
geographically separated, facilities and 


processes working together (or at least 
with mutual cooperation). A mail sys¬ 
tem is made up of the following types 
of components: 

> Programs that allow users to read 
mail and submit new messages — such 
programs are known as “user agents.” 
There are a variety of such mail pro¬ 


grams available under Linux, ranging 
from the traditional (and primitive) 
mail command to character-based, 
menu-driven programs such as elm, 
mutt, and pine to Internet-integrated 
graphical packages like Netscape. In 
addition, some users prefer the mail 
facilities embedded within their favor¬ 
ite editor (such as emacs ). In any case, 
user agents do not typically require a 
lot of administrative time or attention. 

> Programs, typically run as daemons, 
that accept outgoing e-mail (“submis¬ 
sion agents”), send it on its way, and 
begin the process of delivering it to its 
final destination (system and user). 
The latter functions are the responsi¬ 


bility of mail “transport agents.” send- 
mail is the traditional Unix transport 
agent and frequently functions as a 
submission agent as well, although 
some user agents now incorporate this 
capability themselves. Current esti¬ 
mates indicate that about 75 percent of 
all e-mail is transported by sendmail 
Other transport agents include Postfix, 
qmail, and smail Transport 
agents use the Simple Mail 
Transfer Protocol (SMTP) to 
exchange data. 

> A program that actually 
places the message into the 
appropriate user’s mailbox. 
Once mail arrives on its des¬ 
tination system, the transport 
agent hands it off to a “de¬ 
livery agent.” There may be 
separate delivery agents for 
different types of messages 
(e.g., local vs. remote) and 
different transport protocols 
(e.g., SMTP vs. UUCP). 

> The final destination of a mail mes¬ 
sage from the point of view of the 
transport agent may not be the actual 
location from which the user will ac¬ 
cess it. There are two situations in 
which this occurs. The first is when a 
user, organization, or entire site has 
only an intermittent connection to the 
Internet. Messages will be stored for 
them on their ISP’s site until they are 
ready to collect them. A “retrieval 
agent” will then periodically establish 
a connection to the ISP to send new 
messages and collect those that are 
waiting. The most common of these 
programs is fetchmail 
The second situation is when a user 
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UsHiig One; struct Defining a Thread 


Struct _pthread_descr_stract { 

pthread_descr p_nextlive, p_prevlive; 

/* Double chaining of active threads */ 
pthread_descr p_nextwaiting; /* Next element in the queue holding the threads */ 

pthread_descr p_nextlock; /* can be on a queue and waiting on a lock */ 

pthread_t p_tid; /* Thread identifier */ 

int p_pid; /* PID of Unix process */ 

int p_priority; /* Thread priority (== 0 if not realtime)*/ 

struct _pthread_fastlock * p_lock; /* Spinlock for synchronized accesses */ 

/* New elements must be added at the end. */ 

} _attribute_ ( (aligned(32))); /* We need to align the structure so that 

doubles are aligned properly. This is 8 
bytes on MIPS and 16 bytes on MIPS64. 

32 bytes might give better cache 
utilization. */ 


parent should be shared with the child. Table One (pg. 66) 
shows a list of the flags that may be bitwise-or’ed together 
and passed in the call to clone (). Besides the sharing flags, 
the lowest byte of the flags argument represents the num¬ 
ber of the signal to be sent to the parent when the child 
process dies. 

The last argument to clone (), arg, represents the argu¬ 
ment that is to be passed to the function, f n, that clone () 

will execute. The_ clone () function returns the process 

ID of the child process when it succeeds. It will return -1 


when it fails. See the man page for more information about 
the failure cases. 

If you’ve been following this column’s series of articles 
on threads over the past few months, you may be thinking 
that the functionality of clone () seems awfully familiar... 
Well, that’s because it is pretty much how the pthread_ 
create () function behaves, and the similarity is no coin¬ 
cidence. As stated in the man page for clone (), “the main 
use of_ clone () is to implement threads.” The Linux ker¬ 

nel developers felt that the one-to-one method of imple¬ 
menting threads was the 
way to go, and therefore 
designed the kernel to 
enable threads support 
in that way. The imple¬ 
mentors of the pthreads 
library simply followed 
their lead. 

The structure 
of Threads 

Now that we understand 
the clone 0 system 
call, let’s return to our 
discussion about the im¬ 
plementation of threads 
under Linux. In the fol¬ 
lowing, we will be re¬ 
ferring to the implemen¬ 
tation of pthreads found 
in glibc version 2.1.3. 
All of the files mentioned 
are in the linuxthreads 
directory unless other¬ 
wise specified. 


Usfing itoo: The pthread_create() Function in pthread.c 

/* Thread creation */ 

int _pthread_create_2_l (pthread_t *thread, const pthread_attr_t *attr, 

void * (*start_routine)(void *), void *arg) 

( 

pthread_descr self = thread_self() ; 
struct pthread_request request; 

if (_pthread_manager_request < 0) { 

if (_^pthread_initialize_manager () < 0) return EAGAIN; 

} 

request. req__ thread = self; 

request.req_kind = REQ_CREATE; 

request.req_args.create.attr = attr; 

request. req__args . create. fn = start_routine; 

request.recuargs.create.arg = arg; 

sigprocmask(SIG„SETMASK, (const sigset_t *) NULL, 

^request.req_args.create.mask); 

_libc_write(_pthread_manager_request, (char *) ^request, sizeof(request)); 

suspend(self) ; 

if (THREAD_GETMEM(self, p_retcode) == 0) 

*thread = (pthread_t) THREAD_GETMEM(self, p_retval); 
return THREAD_GETMEM(self, p_retcode); 
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The basic structure of the implementation of threads 
is as follows: when the first thread is created (i.e., in the 
first call to pthread_create ( )), a manager thread is 
created to manage the subsequent creation and termina¬ 
tion of threads. The manager will perform the actual cre¬ 
ation of new threads. Once the manager is created and 
initialized, the thread that wishes to create a new thread 
sends a message to the manager via a pipe and then sus¬ 
pends itself until the manager satisfies the request and 
wakes it up. 

The thread manager spaces each of the thread’s 
stacks 2 MB apart. At the top of each thread’s stack 
resides a struct containing the relevant information 
about that thread (e.g., it’s process ID, etc.) for use by 
the manager and other threads. The definition of that 
struct is found in internals.h, and the first few 
fields can be seen in Listing One (pg. 68) (there are 
more than 40 fields in this struct). 

To get a better idea for how threads are laid out in 
memory, let’s look at a picture of the stack after a few 
threads are created (see Figure One, pg. 64). Since stacks 
grow down on most architectures, we draw our picture 
assuming that this is the case in our example. Notice 
that the initial thread lies at the top of the stack. This is 
the thread that represents the main ( ) function in an 
application. The thread descriptor for this thread is kept 
in the space for global variables and is defined in 
pthread. c. Below the initial thread on the stack is the 
thread manager’s stack (it’s descriptor is also in global 
space and defined in pthread.c), followed by the 
struct for each thread and its stack. The manager 
keeps track of each thread by keeping track of the top 
of the thread’s stacks and, therefore, a reference to their 
respective structs. 

Creating New Threads 

Now that we have a clear picture of the memory layout, 
we can look at the code that does the work of creating 
new threads (see Listing Two, pg. 68). When a program 

calls pthread_create (), the_ ^pthread_create_ 

2_1 () function is called in the glibc library — the file 
called pthread. c. First, the function gets the reference to 
itself (thread_self () returns a pointer to the struct_ 
pthread_descr_struct). 

Next, the function creates a request to be sent to the 
thread manager. Notice that the request is of type REQ_ 
CREATE. The request also contains the function to be 
run (start_routine), its argument (arg), and the at¬ 
tributes (attr) the new thread should have. After in¬ 
dicating that the current thread should not be disturbed 
by any signals through the call to sigprocmask (), it 
writes the create request to the write end of the pipe to 
communicate that information with the manager. Then 
the thread suspends itself, waiting for the manager to 
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wake it up once the request 
has been completed. If the 
manager successfully creat¬ 
ed the new thread, the argu¬ 
ment passed into pthread_ 
create () is set, and the re¬ 
turn code is returned. 

The code for the thread 
manager is found in the file 
manager, c . The main func¬ 
tion of this file is_ pthread_ 

manager (), which sits in a 
while 0 loop, polling the 
read end of the communica¬ 
tion pipe. Whenever it sees 
that there is information to 
be read, it reads the request, 
calls the appropriate handler, 
and continues to poll. The 
snippet of code that handles 
the REQ_CREATE request is 
shown in Listing Three. Note 
that the function that does 
the creation is pthread_ 
handle_create (), which 
is also in “manager.c” and is 
shown in Listing Four. 


listing Three; Code That Handles the REILlHlEffnE Renuest 

/* The server thread managing requests for thread creation and termination */ 

int _pthread_manager(void *arg) 

{ 

... /* Initialization and signal handling omitted for brevity. */ 

/* Enter server loop */ 
while(l) { 

n = _poll(&ufd, 1, 2000); 

... /* Other checks omitted for brevity. */ 

/* Read and execute request */ 

if (n == 1 && (ufd.revents & POLLIN)) { 

n = _libc_read(reqfd, (char *)&request, sizeof(request) ) ; 

ASSERT(n== sizeof(request)); 
switch (request. req_„kind) { 
case REQ_CREATE; 

request.req_thread->p_retcode = 

pthread_handle_ereate ((pthread_t *) &request. req_thread - >p_retval, 
request.req_args.create.attr, 
request.req_args.create.fn/ 
request.req_args.create.arg, 

&:request. req_args. create .mask, 
request. req_thread->p_pid, 
request.req_thread->p_report_events, 

Screquest. req_thread->p_eventbuf . eventmask) , 
restart(request.req_thread); 
break; 

/* Other cases */ 
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Listing Four: The iithread_handie_create() Functton 

static int pthread_handle__create (pthread_t ^thread, const pthread_attr_t *attr, 

void * {*start_routine)(void *), void *arg, 
sigset_t * mask, int father_pid, 
int report_events, 
td_thr_events_t *event_maskp) 

{ 

/* Initialization of local variables. */ 

/* Find a free segment for the thread, and allocate a stack if needed */ 
for (sseg =2; ; sseg++) 

{ 

if (sseg >= PTHREAD_THREADS_MAX) 
return EAGAIN; 

if {_pthread_handles [sseg] .h_descr NULL) 

continue; 

if (pthread_allocate_stack(attr, thread_segment(sseg), pagesize, 

&new_thread, &new_thread_bottom, 
&guardaddr, &guardsize) == 0) 

break; 

:■■■■. ■ . ■ ■■ 

__pthread_handles__num++; 

/* Allocate new thread identifier */ 

/* Initialize the thread descriptor. Elements which have to be 
initialized to zero already have this value. */ 

/* Initialize the thread handle */ 

/* Determine scheduling parameters for the thread */ 

/* Finish setting up arguments to pthread_start_thread */ 
new_thread->p_start_args.start_routine = start_routine; 
new_thread->p_start_args.arg = arg; 
new_thread->p_start_args.mask = *mask; 

/* Raise priority of thread manager if needed */ 

/* Do the cloning. We have to use two different functions depending 
on whether we are debugging or not. */ 
pid =0; /* Note that the thread never can have PID zero. */ 

if (pid == 0) 

pid = clone (pthread__start^thread, (void **) new_thread, 

CLGNE_VM 1 CL0NE_FS | CLONE_FILES | CLONE_SIGHAND | 

_^pthread_sig_cancel, new_thread) ; 

/* Check if cloning succeeded */ 
if (pid == -1) { 

} 

/* Insert new thread in doubly linked list of active threads */ 

new_thread'>p_prevlive = ^pthread_main_thread; 

new_thread->p_nextlive = pthread_main_thread->p_nextlive; 

_pthread_main_thread->p_nextlive->p„prevlive = new_thread; 

_pthread_main_thread->p_nextlive = new_thread; 

/* Set pid field of the new thread, in case we get there before the 
child starts. */ 
new_thread“ >p_pid = pid; 

/* We're all set */ 

*thread = new_thread_id; 
return 0; 


Much of pthread_handle_ 
create 0 has been omitted for 
space purposes. For parts that are 
left out, the comments have been 
kept so you can see what occurs 
there. The code that remains is the 
guts of the thread creation mech¬ 
anism. First, this function allocates 
a new stack for the new thread 
through the pthread_allocate_ 
stack () function. It then sets the 
necessary fields in the thread de¬ 
scriptor (including the start func¬ 
tion and the argument to it). Next, 

it calls the_ clone() function 

with the flags discussed above to 
share all attributes with the child. 
The pthread_start_thread () 
function that is run from clone () 
essentially performs some more 
initialization of the thread and 
finishes by calling the start_ 
routine 0 function. And thus, 
the new thread is born. 

There’s Ahways More... 

Hopefully, you have enjoyed this 
whirlwind tour of the implemen¬ 
tation of threads under Linux. If 
you would like to learn more about 
the clone () system call and how 
it relates to fork (), take a look 
at the book Linux Kernel Internals, 
by Beck, Hohme, Dziadzka, Ku- 
nitz, Magnus, and Verworner. As 
you might imagine, the imple¬ 
mentations of the two functions 
are very similar to each other. 

If you are interested in learning 
more about the implementation 
of threads (including the other 
pthreads functions), the code in 
glibc/linuxthreads is very well 
documented and is quite easy to 
read. Also, that directory contains 
a README and a FAQ.html that 
provide even more information 
about the use of threads. In the 
meantime, happy hacking! 


Benjamin Chelf is a freelance auth¬ 
or and engineer at CodeSourcery, 
LLC. He can be reached at chelf® 
codesourcery. com. 


WWW.UNUX-MAG.COM 


MAY 2001 73 





PERL OF WISDOM 

Processing Footnotes 

By Randal L. Schwartz 


I wrote a Web page the other day and realized that I want¬ 
ed footnotes. I wanted to keep the main message in the 
main text and have annotations for some of the side 
points. It’s easy enough to do, right? Just put some text 
in a table at the end, use those cute little sup tags around 
the footnote numbers, and hack away. 

Oops...those little numbers! I started to dread getting six 
footnotes inserted and then having to go back to insert yet 
another between numbers 2 and 3. It was going to be a 
maintenance nightmare. Could Perl help? Of course! 

Expending about 10 times the amount of labor I would 
have spent doing this manually, I hacked out the program 
in Listing One. This obviously wasn’t very efficient, so to 
make the time that I invested worthwhile. I’ll pass the pro¬ 
gram along to you. Besides, it illustrates how to create an 
angly-bracket metalanguage for your HTML and XML pro¬ 
cessing. Yeah, that justifies it. 


The idea is to insert a footnote into the main flow using 
a made-up tag of foot. The processor pass then takes those 
out, replacing them with an anchor link and a unique num¬ 
ber. Then, at the end of the file, all the footnotes are dumped 
out. For an example, look at the end of the program. And, I 
couldn’t stop there, so I decided to allow nested footnotes 
(like those found on the al t. sysadmin. recovery news- 
group). About half of my coding time was spent getting 
those to work. Someday, I will learn to prioritize. 

Let’s see what I wasted an hour on, starting with the first 
few lines that begin nearly every program I write. These 
lines enable warnings, turn on the normal compiler restric¬ 
tions for non-trivial programs, and disable buffering on 
STDOUT. 

Line 5 pulls in the HTML: : Parser, a wonderful piece of 
work maintained by Gisle Aas. This is a C-based module for 
lightning-fast parsing of anglybracket data input, which is 
normally HTML text. This is much faster than hand-rolled 
regular expressions. You’ll find this as part of the LWP mod¬ 
ule family in the CPAN. 


Lines 7 and 8 contain the footnote list and footnote stack 
index, respectively. The first item of @feet is the text of 
the first footnote, numbered 1. The last item of @feet_ 
index (if any) is the subscript of @feet of the current 
footnote we are creating. As each new foot tag is seen, we 
create a new empty footnote in @f eet and put its index at 
the end of @f eet_index. When the note is ended, we pop 
off @feet_index, thus resuming the previous note. If 
there are no items in @feet_index, it’s the main body, 
and we can just copy the data through. 

Yes, this is the logic that it took me the better part of an 
hour to get cleanly. I wanted the footnotes to be numbered 
in the order of the start tags. I kept creating algorithms to 
number them on the basis of the end tag instead — until I 
formulated the indirection table. 

Line 10 keeps track of our nesting of elements. With the 
way I’m using HTML: : Parser, it wouldn’t matter to the 
parser that I have mismatched tags. 
However, since my footnote processing 
is fragile under these circumstances, 
I enforced the XML-notion of “well- 
formedness” and required properly bal¬ 
anced tags. 

You may ask why I did not just use 
XML: : Parser instead of HTML: : Parser. Well, I like the 
callback flexibility of HTML: : Parser for small projects. 

Speaking of which, lines 12 through 17 define my parser 
object. I defined three callbacks. The first one is for text 
items, which will get the text as its first parameter. The sec¬ 
ond one is for start tags, which will get both the original 
text and the tagname extracted. Finally, the end tags are 
also triggered, again getting both the original text and the 
tagname. 

Line 19 turns on xml_mode in the HTML: :Parser, 
which keeps the tags in their original case and slightly 
alters the handling of a few other constructs. Again, this is 
yet more evidence that I really wanted an XML Parser. 

Line 20 pulls in the contents of the DATA filehandle, 

which is the contents of this file under the_ end _token 

below, with my sample data (the description of how I write 
my Perl columns). The result of this parsing pass is a num¬ 
ber of calls to the three callback subroutines, which after 
completion will have printed the main part of the text to 
STDOUT already. We’ll see how this works shortly. 
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The other effect of the parse is the extraction of the foot¬ 
notes into ©feet. Lines 22 to 27 dump this out in a nice 
way. I’m using an HTML table for layout, with a column of 
the footnote numbers and a column of the footnote text. 
Each footnote also has an anchor assigned to it, which we 
can use as the target of an internal anchor reference using 
a fragment identifier. Lacking inspiration, I numbered these 
notel, note2, and so on. 

Line 29 is an exit, redundant because there’s only subrou¬ 
tines from here down; it exists just to keep it clear where 
the program ends. 

Lines 31 to 38 define the text handler, which is called 
whenever HTML : : Parser finds some text outside a tag. 
I’ve selected to pass the text itself as the first parameter, 
which I copy into $text in line 32. If we’re currently in a 
footnote, this text is part of the footnote, so we append it 
to the right footnote. However, the right footnote will be 
the one whose index is in the rightmost element of @f eet_ 


index, hence the indirection. Remember, this is not nec¬ 
essarily the highest indexed footnote (I might have nested 
footnotes, but this would be the exception and not the 
rule). If I’m not in a footnote, the text is simply dumped to 
STDOUT instead. 

Lines 40 to 51 define the handler for the beginning of 
every element. The incoming parameters are the original 
text and the tagname for that start tag (we don’t need the 
attributes). These are assigned to $text and $ tagname in 
line 41. 

Lin e 44 notes the current element name by pushing the 
tag onto the stack. I’ll check this on the close tag in order to 
make sure that the tags are nested properly to make valid 
elements. 

Line 46 does the work for a footnote start tag. First, I cre¬ 
ated the new footnote as empty in line 47. Next, I inserted 
the reference to the footnote in line 48 by faking a text event 
containing the reference. I can’t just print this because I 
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listing One: Using footnotes in HTML — Part I 


#!/usr/bin/perl -w 
use strict; 

$ I++; 

use HTML::Parser; 

my @feet; # final footnote list 

my @feet_index; # indexes into @feet 

my ©elements; # ensure nested tags match 

my $parser = HTML::Parser->new 

( 

text_h => [\&text_h, "text"], 
start_h => [\&start_h, "text, tagname"] , 
end__h => [\&end_h, "text, tagname"] , 

) ; 

$parser->xml_mode (1) ; # keep tags 

case-sensitive 

$parser->parse_file(\*DATA) ; 

# prints main part to STDOUT 

if (@feet) { # we had footnotes? 

print "<hr><table border^'0' 

cellspacing='0' cellpadding^'2'>\n"; 
print "<tr><td valign='top'><sup><a 
name='note$_'>$_</a></sup></td>", 
"<td>$feet[$_-l]</td></tr>\n" 
for l..@feet; 
print "</table>"; ■ 

} 

exit 0; # end of code 


30 

31 sub text_h { 

32 my ($text) = 

33 if (@feet_index) { # are 

we inside a footnote? 

34 $feet [$feet_index[-1]] $text; 

# append to that 

35 1 else { 

36 print $text; # just show it 

37 } 

38 ] 

39 

40 sub start_h { 

41 my ($text, $tagname) = 

42 

43 ## ensure proper nesting 

44 push ©elements, $tagname; 

45 

46 if {$tagname eq "foot") { 

47 push ©feet, ""; # the note itself 

48 text_h("<sup><a href='#note".©feet. 

"'>".©feet."</a></sup>"); 

49 push ©feet_index, $#feet; # 

pointer to note 

50 return; 

51 } 

52 

53 text_h($text) ; # uninteresting start tag 

54 } 

55 

56 sub end_h { 

57 my ($text, $tagname) = @_; 

58 

59 ## ensure proper nesting 
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might still be in another footnote; faking the text event 
“does the right thing.” (For better maintenance, Fd proba¬ 
bly pull the “add text” operation to a separate subroutine 
that both the text handler and this handler call, but this 
worked for this quick-and-dirty program.) 

Line 49 adds the footnote index onto the footnote stack. 
Note that we cannot do this before the previous line because 
the footnote reference would end up inside itself. 

Line 53 handles the start tags that are of no interest (every¬ 
thing except foot tags) by simply copying them as-is to 
the current output (either a footnote or stdout). 

Lines 56 to 72 handle the end tags. Again, the text and 
tagname end up in variables, defined in line 57. 

Lines 60 through 64 handle the verification of properly 
nested tags. If there’s no start tag, or the tags don’t match, 
a swift and painless death is the result. 

Lines 66 to 69 handle the foot end tag, which is the only 
one of interest. If I find one, I simply pop an entry off the 
@f eet_index array, which will pop us back to the previ¬ 


ous footnote on the next text item seen. If we don’t find any, 
we’re back to dumping to STDOUT. 

Line 71 dumps the other uninteresting end tags as needed. 

That’s all there is. It’s not rocket science, but it gets the 
job done. As sample text, I included an outline of what it 
takes to write a Perl column. If you run the program, you 
will get the HTML output shown in Listing Two. 

Note how the footnotes have been replaced with internal 
fragment references and the content of the footnotes has 
become a table at the end. Yes, I could have done all this 
by hand, but it was more fun to write the program and get 
it done right, once and for all. So, don’t fear footnotes and 
writing tiny metalanguages for those odd tasks. 


Randal L. Schwartz is the chief Perl gum at Stonehenge Con¬ 
sulting and co-author of Learning Perl and Programming Perl. 
He can be reached at merlyn@stonehenge.com. Code listings 
for this column can be found at:http://www.stonehenge.com/ 
merlyn/LinuxMag/. 


listing One: Using Fontnotes in HTML — Part ii 


60 die "saw $text outside of element" 

61 unless ©elements; 

62 die "saw $text nested inside 

<$elements[-1] >" 

63 unless $elements[-1] eq $tagname; 

64 pop ©elements; 

65 

66 if ($tagname eq "foot") { 

67 pop @feet_index; # no longer 

accumulating here 

68 return; 

69 } 

70 

71 text_h($text) ; # uninteresting end tag 

72 } 

73 

74 END 

75 <h2>Writing a Perl column</h2> 

76 Writing a magazine column about Perl is 

a simple<foot>for some!</foot> task. 

77 Just perform the following steps: 

78 <ol> 

79 <li>Think of a problem to 

80 solve<foot>You can ask around for 

help here. 

81 I keep an archive of "todo" ideas, 

and it really helps.</foot>.</li> 

82 <li>Write the code to solve it.<foot>The 

code should be between 50 and 200 

83 lines for optimum column 

84 1ength<foot>About 10,000 characters. 

</foot>.</foot></li> 


85 <li>Fret over the code for a few hours 

<foot>Or a few minutes.</foot>.</li> 

86 <li>Write the column<foot>I use POD<foot>See 

<tt>perldoc perlpod</tt>.</foot> 

87 format.</foot>.</li> 

88 <li>Show the column to a group of friends 

89 on IRC<foot>UsuallY the 

<tt>#perl</tt> channel.</foot> 

90 for a quick peer review.</li> 

91 <li>Turn it in<foot>By email.</foot> 

to the editor.</li> 

92 <li>Wait a few days for the 

galleys<foot>Usually a 

93 PDF<foot><i>Portable Document 

Format</i> from 

94 Adobe<foot>See <tt>www.adobe.com</tt> for 

downloads.</foot>.</foot>.</foot> 

95 to come back.</li> 

96 <li>Grimace over the hacks to your lovely 

97 prose<foot>just kidding, guys!</foot> 

and provide corrections to 

98 the corrections. 

99 </li> 

100 <li>Wait a few months<foot>Or so it 

seems, since the deadline 

101 for an April cover is usually the first 

week of January. </foot> for it 

102 to "hit the stands" . </li> 

103 <li>Wave the magazine in front of your 

friends<foot>Or the cute girl 

104 at the bookstore checkout 

counter.</foot>!</li> 

105 </ol> 
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Listing IWO: The HTNIL Outpiit of UsOng One 


<h2>Writing a Perl column</h2> 

Writing a magazine column about Perl is a simple<sup>[1]</sup> task. 

Just perform the following steps: 

<ol> 

<li>Think of a problem to 
solve<sup>[2]</sup>.</li> 

<li>Write the code to solve it.<sup>[3]</sup></li> 

<li>Fret over the code for a few hours<sup>[5]</sup>.</li> 

<li>Write the column.</li> 

<li>Show the column to a group of friends 
on IRC<sup>[6]</sup> 
for a quick peer review.</li> 

<li>Turn it in<sup> [7]</sup> to the editor.</li> 

<li>Wait a few days for the galleys<sup>[8] </sup> 
to come back.</li> 

<li>Grimace over the hacks to your lovely 
prose<sup> [9]</sup> and provide corrections to 
the corrections. 

</li> 

<li>Wait a few months<sup>[10] </sup> for it 
to "hit the stands".</li> 

<li>Wave the magazine in front of your friends<sup>[11]</sup>!</li> 

</ol> 

<hr><table border^'0' cellspaeing='0' cellpadding='2'> 

<tr><td><sup>[1]</sup></td><td>for some!</td></tr> 

<tr><td><sup>[2]</sup></td><td>You can ask around for help here.</td></tr> 
<tr><td><sup>[3]</sup></td><td>The code should be between 50 and 200 
lines for optimum column 
length<sup>[4]</sup>.</td></tr> 

<tr><td><sup>[4]</sup></td><td>About 10,000 characters.</td></tr> 
<tr><td><sup>[5]</sup></td><td>or a few minutes</td></tr> 

<tr><td><sup>[6]</sup></td><td>Usually the <tt>#perl</tt> channel</td></tr> 
<tr><td><sup> [7 ]</sup></td><td>By email.</td></tr> 

<tr><td><sup>[8]</sup></td><td>usually a PDF.</td></tr> 

<tr><td><sup>[9]</sup></td><td>just kidding, guys!</td></tr> 

<tr><td><sup> [10]</sup></td><td>Or so it seems, since the deadline 
for an April cover is usually the first week of January.</td></tr> 
<tr><td><sup>[11]</sup></td><td>Or the cute girl 
at the bookstore checkout counter.</td></tr> 

</table> 
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TECH SUPPORT 


Top Tech Support Questions 

By Drew Streib 


i want to get a bandwidth nsage 
graph for my machine, hot don’t 
have a switch with SNMP. Cant get 
this directiy from the iinux box? 

You can get a lot of information from 
a Linux machine via SNMP, including 
network traffic to build bandwidth 
graphs, ril explain a method using 
mrtg (Multi Router Traffic Grapher). 

You’ll first need to install the SNMP 
daemon, preferably using your distri¬ 
bution’s package management system. 
The installation should start the SNMP 
daemon. You can check for this by run¬ 
ning the following: 

# ps aux I grep snmpd 

You should see an snmpd program 
running here. If you do not, you may 
need to start the daemon yourself. De¬ 
pending on the distribution you are 
running, you’ll probably need to type: 

# /etc/init.d/SNMPd start 

or 

# /etc/rc.d/init.d/snmpd start 


WorkDir: /var/www/mrtg 
WriteExpires: Yes 

Title [^]: Traffic Analysis 


If this starts successfully, you’ll want 
to make sure that snmpd is appropri¬ 
ately started by init in your startup 
scripts. If this does not start the SNMP 
daemon, or if an init file does not exist, 
you should check to see if SNMPd is, in 
fact, installed. 

There is a lot to learn about SNMP. 
For now, you need to know that it pro¬ 
vides several ways to access and con¬ 
trol data, and it organizes much of this 
information in groups called “commu¬ 
nities.” By default, most Linux instal¬ 
lations will create a community called 
public that will contain basic informa¬ 
tion. This should be available on the 
local machine via localhost. 

You can test this by using a program 
called snmpwalk to peruse the exports 
on your machine. To do this, try issu¬ 
ing the command: 

# snmpwalk -c public localhost 

You should see a lot of information 
dumped to screen. Anything less than 
this and you’ll need to ensure the oper¬ 
ation of snmpd and that a public com¬ 
munity has been created and is view¬ 
able by localhost Since there are a 


for dtype.org 


myriad of options here, if this default 
setup doesn’t work for you, please visit 
the SNMP page at http://net-snmp. 
sourceforge.net/. 

Once snmpd is running on your sys¬ 
tem and access is properly set up, you 
will be able to use programs like mrtg, 
which can use the SNMP data for var¬ 
ious purposes, mrtg itself is a graphing 
program that you will probably need 
to install. All major Linux distributions 
call the package mrtg. You can check 
if the program exists by typing: 

# which mrtg 

For now, let’s setup a basic band¬ 
width graph available through your 
Web server. I’ll be using /var/www as 
the document root and /etc/mrtg.cfg 
as the preferred location for the mrtg 
configuration file in the examples here. 
You’ll need to create a /var/www/mrtg 
directory, which will then be accessed 
as http://yourserver/mrtg/ to access 
the mrtg graphs. 

If you don’t have one already, cre¬ 
ate an mrtg.cfg, as shown in the List¬ 
ing One. The data that follows is for my 
own server at dtype. org. Substitute 
all the appropriate values for your own 
server, including a name for this mrtg 
block config (mine is verio228). Mul¬ 
tiple configs such as these can exist in 
the same mrtg.cfg file. 

With this file in place, you should 
be able to run the following: 

# mrtg -c /etc/mrtg.cfg 

The first two times you run this, 
mrtg will complain that it does not 
have previous values. This is normal, 
as mrtg works by comparing numbers 


Title[verio228]: Verio 207.20.109.228 

PageTop [verio228] : <Hl>dtype.org at Verio 207.20.109.228</Hl> 

Target[verio228]: /207.20.109.228:public@localhost 

MaxBytes[verio228] : 1280000 

XSize[verio228]: 600 

YSize [verio228] : 300 

Options[verio228]: bits 


Lisflng One; A Basic inrtg.cfg Hie 
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UsUng ItoO: Getting the New Kernel Source 

# cd /usr/src/ 

# wge t ht tp: / / f tp. sourcef orge. net /pub /1 inux/kernel /v2.4/1 inux -2.4.2. tar. bz 2 

# cat linux-2.4.2 . tar.bz2 | bunzip2 | tar xv 

# mv linux linux-2.4.2 

# In -s linux-2.4.2 linux 

# cp /usr/src/oldlinux/.config /usr/src/linux/ 

# cd /usr/src/linux/ 


(from SNMP in this case) 
at regular intervals. The 
first time you run mrtg 
with this config, there 
will be no basis data for 
the interval. You should 
also see files appear in 
/var/ www/mrtg/. 

Pointing a browser at 
http://yourserver/mrtg 
should give a file listing, including a 
.html file that includes the graphs 
youTe looking for. The numbers will 
be disturbingly low right now because 
you haven’t given mrtg time to run and 
collect data. By default, mrtg needs to 
run on five-minute crons. 

You can learn a lot more about mrtg 
at the homepage: http://ee-staff.ethz. 
ch/~oetLker/webtools/mrtg/mrtg.html. 

mrtg and snmpd both have options 
far beyond setting up simple band¬ 
width graphs. They are both very pow¬ 
erful and can be very useful to system 
administrators looking to monitor and 
control boxes remotely. 

I want to upgrade a kernel on a 
server running remotely, but I am 
afraid of rebooting the machiiiii 
and having It fall on staruil> 

Is there a way to guaraiinii 
It comes back up? 


tory with a version number, so assum¬ 
ing you are upgrading to the 2.4.2 ker¬ 
nel, make sure there is no existing/usr/ 
src/linux (by moving it elsewhere or 
deleting the symlink) and then execute 
the commands found in Listing Two. 

If you were able to get an existing 
.config file from the /usr/src/linux/ 
directory, then execute: 

# make oldconfig 

This will only ask about configura¬ 
tion items that have changed since 
your last config. If your kernel versions 
ire similar, this may be a small list, 
otherwise, it may take a while. 

' Regardless of whether or not you 
had the old config, you should really 
now check the config for your ma¬ 
chine options. If you didn’t have an 
old config, you’ll need to do this from 
scratch. I like menuconfig. 


3) Gtiaek netwo^ SSliP: Be sure that 
your box defaults to its current net¬ 
work setup. This sounds redundant, 
but if you configured the box locally 
via an ifconfig line and didn’t change 
the default interface behavior, you’ll 
be out of luck if you don’t check this. 

While playing with network configs, 
keep in mind that you’re currently 
logged into the box via the network. 
An if down ethO command will like¬ 
ly leave you stranded. 

4) Gbpci basie mmmk baaiiiiis. if you 
are logging in through ssh, make sure 
that this starts in the init scripts. 

5) llllt iiiO.CORf: Be sure to leave your 
existing kernel in the options as the 
default. After running lilo, your cur¬ 
rent kernel will still be the default. At 
this point, run: 

# lilo -R newlinuxname 


I wish. There are a few steps you can 
take, however, to try to minimize your 
headaches here. 

I’ll outline my own procedure for 
doing this, which I must stress is only 
one way. It is, however, something I’ve 
done several times with some reliabil¬ 
ity. I have to assume that you’re some¬ 
what familiar with how to upgrade a 
kernel, or else you really shouldn’t be 
attempting to do so remotely. 

It helps a lot if you have the old ker¬ 
nel source; you can use this to retrieve 
the configuration for the kernel you 
are now running. The important file to 
find is the .config file for the running 
kernel. 


# make menuconfig 

It is very important to verify at least 
the basic hardware configuration of 
the box. I can’t emphasize enough the 
need to carefully check configurations 
for hard drive types and drivers (SCSI 
and IDE), Ethernet adaptors, and other 
hardware your machine will need to 
boot and get onto the network. 

Keep in mind that you will not be 
able to compile as a module some¬ 
thing that you need to mount the root 
partition, because modules will not 
be available until the root partition is 
mounted. 

lake iiiii instati kernel moifiiiesi Usu¬ 


This will set lilo to boot newlinux- 
name (change as appropriate) for the 
next boot, but will still default to the 
old kernel for subsequent boots. This 
is very helpful if you hang the box, 
because then you can simply get an 
onsite person to power cycle it and 
boot into the known working kernel. 

After a successful boot, don’t forget 
to change the default back! 

6) R^not. 

Good luck. No matter how many 
times I do this. I’m always anxious un¬ 
til the ping finally returns. 


1) Prip thi wm fcainals Download the 
new kernel source. It is a good prac¬ 
tice to name the kernel source direc¬ 


ally when I mess up a remote reboot 
it is because I forgot to install the new 
modules. 


Drew Streib is a coder, admin, and writ¬ 
er with VA Linux Systems. He can be 
reached at tech@linux-mag.com. 


WWW.LINUX-MAG.COM 


MAY 2001 83 





Zonker’s Product Picks 

By Joe **Zonkef* Brockmeier 


nO-coni: At Your Service 

Broadband access in the home is becoming more and more common. 
With all that bandwidth to spare, many folks would like to run a Web 
server from home. Unfortunately, it's kind of hard for people to surf to 
you don’t have a static IP, which many ISPs charge extra for. 

TZO.com has a number of solutions for folks with a fat pipe and a dynamic IP. TZO.com provides client soft¬ 
ware that sends your assigned dynamic IP to TZO.com, where they handle the DNS service and point visitors to 
your Web site. Their basic plan allows you a subdomain like “myhost.tzo.com” for $24.95 a year, and the pre¬ 
mier plan allows you a regular domain for $59.95 a year. They also offer mail storage and forwarding and other 
services for additional fees. For homes and small offices with modest Web needs, TZO.com might be the an¬ 
swer. You can download Linux, MacOS, Windows, and Java clients for the service from http://www.tzo.com. 
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NetssiTPServer is a 
New Way to FTP 

If your FTP needs are a bit exotic, 
the Net::FTPServer might be the 
FTP server for you. 

The Net::FTPServer project is a 
Perl module that has been tested 
under Linux 2.2 and Perl 5.00503, 
but should work on most Unix-type 
systems. In addition to standard FTP services, Net::FTPSer- 
ver allows for the creation of a “virtual filesystem,” as well 
as the serving of files from either a relational database or 
from memory. 

Net::FTPServer is a project commissioned by Bibliotech. 
Code is available under the GNU General Public License 
from the project home at http://ftpserver.annexia.org/. 
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Nautilus: Ihe Shell Bame 

The folks at Eazel have upped the ante in the battle 
for the computer desktop. Instead of playing catch¬ 
up with other OSes, the Nautilus file manager brings 
features to Linux not found anywhere else. 

This slick GUI shell lets you view contents of files 
without opening them and zooms in and out on your 
folders, depending on how much detail you want to 
see. Nautilus is designed to browse local files and Web 
content. 

The price for Nautilus is right too. Eazel is distrib¬ 
uting Nautilus for free under the GPL and hoping to 
make money by offering Nautilus users services like 
online storage and software updates. Eazel was 
founded by former Apple developers Mike Boich and 
Andy Hertzfeld. 
http://www. 
eazel.com 



Innovator SIX; The Penguin Speaks 

Small businesses looking for a Linux voice processing solution should 
take a look at the Innovator 8LX. The 8LX is IstCTTs Linux addition 
to their line of communications hardware that handles voice mes¬ 
saging, faxes, e-mail, and text messages. 

The Innovator 8LX comes in two to eight port configurations. The 
Innovator has an easy to use GUI configuration system that can be 
used over a LAN or WAN. The Innovator works with IstCTTs Win¬ 
dows-based desktop messaging and communications management 
software to provide a full communications solution. 

The Innovator is expected to be available for shipment in July; prices are currently unavailable. 
IstCTI offers a number of hardware and software communications solutions; they can be found at 
http: //WWW. 1CTI. com/. 
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Opera for Unux: Small and Speedy 

Browsing fanatics now have another option for surfing the Web under 
Linux — the Opera Browser. Opera for Linux has been under development 
for quite some time, but should be out of beta by the time you read this. 
Opera is very fast and has a different layout than Netscape, which some 
users prefer. The browser supports most Web standards, including stan¬ 
dard HTML, CSS 1 and 2, XML, WML, SSL, and most JavaScript. Opera 
requires the Qt 2.2 libraries, which you already have if you're running 
KDE2. If not, you can just download the statically linked version. 

The Opera Browser for Linux comes in two options. The free version is a Web browser with a ‘‘standard” sized 
ad banner at the top of the window. The $39 version is ad-free. The download is pretty slim, and packages are avail¬ 
able in RPM, tar-gzip, and Debian formats. You can find Opera Software on the Web at http://www.opera.com/. 



Han Keyboard: Half the 
Keyboard, Iteice the Productivity 



Macromedia Flash 5: 
Get Flashed! 


macromedia 
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We may never know the sound of one hand 

clapping, but now we can find out what one hand typing sounds 

like. According to information on the Half Keyboard site, many 

users can achieve 62 words per 
minute with the Half Keyboard. 
Hunt and peck typists won’t gain 
any speed, but they won’t lose 
any either. 

The Half Keyboard is a great 
solution if you’re looking for a 
portable keyboard for your Palm 
Pilot or if you’re putting together 
a wearable computer. The Half Keyboard comes in several models 
for Palm Pilots, Macs, and PCs. There are a couple of different 
Linux drivers available for the Half Keyboard as well. 

The Palm Pilot, PS/2, and USB versions are priced at $99, and 
the portable version is priced at $199. You can find out more infor¬ 
mation about the Half Keyboard on their Web site: http://www. 
halfkeyboard.com/. 


It seems that almost every 
site contains Flash anima¬ 
tion of some sort these days. Linux users 
have often been out of luck, because 
Flash support under Linux has been out¬ 
dated at best. 

It is now easier for Linux and Solaris 
users to waste more time on the Web 
with the Macromedia Flash 5 player. The 
player allows Linux and Solaris users to 
watch Flash multimedia presentations 
and animation. 

Macromedia produces a number of 
multimedia players and content-produc¬ 
ing tools for the Web. The Macromedia 
Flash Player is a free download available 
from their site: http://www.macromedia. 
com/shockwave/download/alternates/. 




There’s no be 
10 meter tall 
there’s Shogo: 

Shogo featu] 
Shogo offers s 
of first-person 

You can ord 
Linux by Hypi 
Belgium, http: 


SlioBO: Mobile Armor Division 


_' way to unwind after a hard day’s work than to pilot a 

robot that blows up other robots. Until you can do that, 

: Mobil Armor Division. 

res heavy-duty 3D action powered by the LithTech 3D engine, 
some of the most realistic gore and lighting this side of Quake 11. If you’re a fan 
L shooter action, Shogo should be on your wish list, 
ier Shogo: Mobile Armor Division from TuxGames.com. Shogo was ported to 
erion Entertainment; they also port games to the MacOS and Amiga. Hyperion is based in Leuven, 
://www.hyperion~software.com/Jinux/shogo„game.html 


Got a product pick of your own for Zonker? Drop him a line at zonker@linux-mag.com. 
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This June, the leading 


companies and conferences 
in technology take center 
stage in New York City. 


Limited Engagement. One Week Only. 


At PC EXPO, the expo portion of 
TECHXNY, you’ll find mobile & wireless, 
business solutions, leading-edge 
internet security advances, ASPs, the 
latest in Linux, storage technologies 
and more. The best products, services 
and real-world solutions—all delivered 
by the best vendors and solutions 
providers in the IT industry. 

T 


TECHXNY’s full week of conferences, education summits and 
special events has something for just about everyone. The IT 
innovation Conference focusing on innovative security solutions... 
an IT infrastructure built for speed...top-notch information-sharing 
architecture...Best of Brainshare...SAN and Clustering Summits... 
and the wide, wide, wireless world. 

Marketing Integration Xchange, a conference and exposition, 
focusing on the use of technology to maximize marketing 
effectiveness and optimize customer relationships. 

There’s the Finance Exchange. The Angel Society Forum for 

entrepreneurs. First Look for senior-level execs. Solutions 
Integrator Think Tech. PC Career Expo. And still more targeted 
programs and events are on their way to bring you the cutting- 
edge of IT today. 


Conference Dates: june 25-28, 2001 
Exposition Dates: june 26-28, 2001 
Location: Javits Center, New York City 


To learn all about what there is to see, do, hear, and learn at 
TECHXNY this June, log on to www.techxny.com. And while you’re 
there, make sure to register right awayl 


Flagship Sponsors 

®ljeJfcUfJ|or^tmcs NOV 6 II. VERITAS 


Platinum Sponsors 

COMPAa 


handspring' 


MWT 


Keynote Sponsor 


Sponsor of IT Innovation Conference 


I BusinessWeek I 


I -unow. buitinessweek. cc 


Forbes 


REGISTER TODAY AT: wmY.EecfflKffly.com Use source code: M3AA 
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SHUTDOWN 



Mr. Cola 
from tho 
of El 


Geeks love Linux. 
And I want Geeks to 
love me. And why 
shouldn't they? I am 
drug that increases 
productivity. I am 
the water that 
slakes their thirst, 
the lover that 
keeps them 
company at any 
hour of the day. 


So I embrace 
Linux. After all, 
the more they 
work on it, the 
less they want to 
sleep. And then 
they're 
MINE. 


"Whero's wilr MdiciionP’ 


littp://Mniinii.userfrienilly.org/ 
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The First Dual Athlon® 
With DDR Memory 



Q2 2001 

www.aslab.com 
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ReDefining Linux Performance 
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Red Har Embeddedi^'olutioiis help you 
manage your pro^uqtSE ^teg[H||||ta^ 


Copyright© 2001 Red Hat, Inc. All rights reserved. Red Hat and tte Red Hat "Shadow Man" 
logo are trademarks or registered trademarks of Red Hat, Inc. in the US and other countries. 
Linux is a registered trademark of LinusTorvalds. Alt other trademarksTcae the property 
of their respective owners. .... — 


Get GNUPro, Embedded Linux, eCos, and our 
other Red Hat embedded solutions. They'll help 
speed your product to market and keep it from 
becoming tomorrow's eight-track. 

Learn more: www.redhat.com/embedded. 

Or contact us at embedded-info@redhat.com. 


Red Hat has GNUPro tools and embedded 
operating systems to build a range of 
embedded products—from MP 3 players 
to Mars Landers. 


And you pick the platform. We support 
ARM/Thumb/StrongARM/XScale, Eujksu FR, 
Hitachi SuperH, IA- 64 , IDT MIPS, MIPS 32 4 Kc, 
Motorola 68K, Matsushita AM 32 /AM 33 , NEC 
VR MIPS, PowerPC, Toshiba MIPS TX series, 
and x86/Pentium to name a few. : ^ H 














